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In  anticipation  of  the  base-year  survey  of  the 
National  Education  Longitudinal  Study  of  1988  (NELS:88),  a  field  test 
of  the  questionnaire  and  test  items  was  conducted  in  1987.  NELS : 8t  is 
a  national,  longitudinal  study  designed  to  provide  trend  data  about 
the  critical  transitions  of  young  people  as  they  develop,  attend 
school,  and  enter  the  work  force.  The  base-year  NELS  will  survey  a 
sample  of  26,200  eighth  graders  from  800  oublic  and  200  private 
schools.  Follow-up  surveys  will  be  repeated  every  two  years.  NELS 
questionni  res  include  surveys  of  students,  teachers,  administrators, 
and  parents;  both  biographical  and  attitudinal  items  are  included. 
The  student  survey  also  contains  cognitive  tests  in  reading/English, 
mathematics,  science,  and  social  studies.  Five  states  were  selected 
as  field  test  sites  for  these  instruments.  A  number  of  analyses  were 
conducted  on  the  test  items  and  the  sampling  procedures.  Both 
classical  test  theory  and  latent  trait  theory  were  used  to  determine 
the  most  appropriate  items.  The  field  test  also  examined  the  effects 
of  conducting  orientations  and  ways  of  distributing  parent 
questionnaires.  Results  generally  demonstrated  the  appropriateness  of 
the  survey  design,  procedures,  and  instruments.  Problems  with 
specific  items  were  repor^d.  This  report  includes  chapters  on:  (1) 
field  test  preparation;   (z)  student  data  collection;  (3)  analysis  of 
student  survey  results;   (4)  parent  survey;  and  (5)  school  and  teacher 
surveys.  The  extensive  appendices  contain  nine  research  instruments: 
Eighth  Grade  Locator  Booklet;  Eighth  Grade  Questionnaire;  Tenth  Grade 
Questionnaire;  Twelfth  Grade  Questionnaire;  Parent  Questionnaire; 
Teacher  Questionnaire;  School  Questionnaire;  New  York  Supplement;  and 
Summary  of  Cognitive  Test  Battery.  (GDC) 
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OVERVIEW  OF  THE  FIFLD  TEST  OF 
THE  NATIONAL  EDUCATION  LONGITUDINAL  STUDY  OF  19&8  (NELS:88) 


Background 

In  anticipation  of  the  base-year  effort  for  NELS:88,  NORC  and  its  subcontractors, 
Educational  Testing  Service  and  Westat,  conducted  a  field  test  in  early  1987.  The 
field  test  had  three  general  purposes:  to  test  instruments,  forms,  and  procedures;  to 
experiment  with  different  approaches  to  data  collection;  and  to  evaluate  the  overall 
study  desifin. 

NELS:88  joins  the  National  Longitudinal  Study  of  the  High  School  Class  of  1972 
(NLS-72)  arid  High  School  and  Beyond  (HS&B)  as  the  third  in  a  series  of  longitudinal 
studies  sponsored  by  the  Center  for  Education  Statistics  of  the  U.S.  Department  of 
Education.  These  studies  are  designed  to  provide  trend  data  about  critical 
transitions  experienced  by  young  people  as  they  develop,  attend  school,  and  embark  on 
careers.  NELS:88  focuses  on  a  sample  of  students  who  will  be  enrolled  in  the  eighth 
grade  in  198a  Follow-up  surveys  at  *wo-year  intervals  will  be  conducted  to 
facilitate  long-term  trend  analyses. 

Study  Design 

The  overall  design  for  the  study  includes  four  major  component  surveys—of 
students,  parents,  school  administrators  and  teachers.  (The  student  survey  includes  a 
cognitive  test  component)  The  field  test  results  were  used  to  refine  the 
questionnaires  for  these  four  respondent  populations,  and  to  calibrate  items  of  the 
student  cognitive  test  battery  so  that  reliable  and  valid  base-year  versions  of  this 
longitudinal  test  could  be  developed.  The  major  elements  (and  their  relationships  in 
time)  of  the  field  test  student,  teacher  and  school,  a*d  parent  surveys  are  depicted 
in  the  three  attached  process  diagrams. 

Survey  Instruments 

The  primary  research  instruments  are  a  series  of  cognitive  test  batteries  in  four 
subject  matters  (Reading/English,  Mathematics,  Science,  and  Social  Studies),  and 
questionnaires  covering  four  respondent  populations— students,  parents,  teachers,  and 
school  administrators.  There  are  also  three  supplemental  sections  to  the 
questionnaires:  (a)  the  Language  Minority  Supplement,  funded  by  the  Office  of 
Bilingual  Education  and  Minority  Language  Affairs;  (b)  the  Mathematics  and  Science 
Supplement,  sponsored  by  the  National  Science  Foundation;  (c)  the  Gifted  a-c?  Talented 
Supplement,  funded  by  the  Office  of  Planning,  Budget  at.d  Evaluation  of  the  Department 
of  Education. 

Sample 

For  the  base-year  survey  (1988),  a  nationally  representative  sample  of  1,000 
schools  (800  public  school?  and  200  private  schools,  including  parochial  institutions) 
will  be  drawn.  Within  this  school  sample,  26,200  eighth  grade  students  will  be 
selected  at  random. 

In  the  field  test,  five  states  were  selected  as  field  test  sites  >n  the  basis  of 
their  demographic  heterogeneity  and  regional  representativeness.  Two  counties  were 
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chosen  within  each  state.  Schools  were  chosen  with  probability  proportional  to  eiyhth 
grade  enrollment  within  a  regular  puolic  school  stratum  and  a  special  oversampled 
private  school  stratum.  Some  fifty-one  eighth  grade  schools  participated.  Eighth 
grade  students  were  randomly  selected,  and  Asian-Pacific  and  Hispanic  students  were 
oversampled.  Scnool  administrators  and  teachers  were  sampled  in  all  eighth  grade 
schools;  the  parent  survey  was  conducted  in  a  subsample  of  34  schools.  The  field  test 
also  included  thirty  high  schools,  so  t.._t  tenth  and  twelfth  grade  cognitive  test 
observations  could  be  obtained.  Some  1,408  eighth  grade  students,  2,082  high  school 
students,  785  parents,  281  teachers,  and  46  administrators  completed  the  field  test 
research  instruments. 


Evaluation  of  Instruments  and  Procedures 
Instruments. 

Evaluation  of  questionnaire  data  was  carried  out  on  seven  levels: 

-  Analysis  of  critical  item  edit  and  retrieval 

-  Analysis  of  item  non-response 

-  Logical  consistency  analyses  (inter-item  consistency,  filter 

and  dependent  question  consistency) 

-  Analysis  of  response  variation  by  position  in  the  questionnaire 

-  Comparison  of  student  and  parent  reports 

-  Analysis  of  scale  reliabilities 

-  Analysis  of  item  response  variation  by  selected  respondent 
characteristics 


Cognitive  test  item  parameters  were  estimated  for  the  eighth,  tenth,  and  twelfth 
grades.  Held  test  data  were  evaluated,  using  both  classical  and  Item  Response  Theory 
(IRT)  t-Khniqies  to  determine  the  most  appropriate  items  for  inclusion  in  final  (base 
year)  forms  o'  uach  of  the  four  tests. 

Procedures. 

Major  data  collection  procedures  evaluated  in  the  field  test  included:  sampling 
and  sample  updating;  state,  district,  and  school  contacting;  data  collection  for  all 
four  respondent  populations;  and  data  preparation.  The  various  documents  used  in 
these  procedures  also  were  assessed.  Both  quantitative  analyses  (for  example, 
comparison  of  response  rate  and  error  differences  associated  with  different 
procedures)  and  qualitative  analyses  (including  debriefings  of  field  staff  and  school 
coordinators)  inform  the  evaluation  of  procedures  and  the  formulation  of 
recommendations  for  the  base  year. 

The  field  test  included  several  experiments  in  data  collection  methods.  The  two 
most  important  of  these  were  an  investigation  of  the  effects  of  holding  orientation 
days,  and  an  experiment  involving  different  means  of  distributing  the  parent 
questionnaire. 

Results  and  Recommendations 

The  field  test  demonstrated  that  the  survey  design,  procedures,  and  instruments 
are  generally  appropriate  for  the  objectives  of  the  study. 
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High  individual  response  ntes  were  obtained.    The  eighth  grade  student 
completion  rate  was  92  percent  teacher  96  percent  school  (principal/administrator) 
00  percent  and  parent  92.1  percent  (for  those  parent  cases  receiving  the  full  follow- 
up  treatment  whose  children  participated;  or  84.7  percent  of  the  parents  of  all 
eligible  students).  It  would  appear  that  high  eighth  grade  response  rates  generally 
can  be  obtained,  though  securing  district  and  schooHevel  participation  will  remain  a 
major  challenge. 

The  field  test  also  identified  a  number  of  areas  in  which  procedural 
modifications  should  be  made.  Areas  for  improvement  include  Identification  and 
selection  of  OBEMLA  supplementary  students,  updating  of  the  student  sample,  and 
teacher  selection.  Analysis  of  questionnaire  data  confirmed  that  the  general  approach 
to  data  collection  is  sound,  but  numerous  specific  modifications  in  item  wording  and 
questionnaire  format  are  desirable. 

Held  teat  results  showed  that  adults  jre  better  reporters  of  certain  kinds  of 
important  information  than  are  eighth-grade  childen.  Items  in  the  student 
questionnaire  should  be  limited  to  those  for  which  the  individual  student  is  the  only 
or  best  informant — for  example,  student  experiences,  perceptions,  beliefs, 
expectations  and  attitudes.  Data  on  parents'  occupations,  receipt  of  special 
services,  health  history,  and  home  and  learning  environments  should  be  collected 
primarily  from  parents  and  school  administrators  and  teachers. 

Results  argue  for  riving  serious  consideration  to  holding  Orientation  Day  in  all 
schools.  At  the  very  jast,  orientations  should  be  scheduled  for  schools  t*  t  are 
likely  to  be  disorganized  and  difficult  to  work  in,  schools  that  insist  on  explicit 
parental  consent,  and  many  non-Catholic  private  schools. 

Further  thought  should  be  given  tc  use  of  non-English  contacting  materials  and 
survey  instruments,  and  to  the  possibility  of  offering  schools,  districts,  and  peihaps 
individuals  selected  data  from  the  cognitive  tests  and  the  several  questionnaires. 

The  attached  summary  of  the  fiMd  test  report  gives  further  detail  about  the 
principal  methods  and  findings  of  the  field  test.  The  attached  process  diagrams 
illustrate  the  flow  of  field  test  events. 
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THE  FIELD  TEST  OF 
THE  NATIONAL  EDUCATION  LONGITUDINAL  STUDY  OF  1988  (NELS:88* 
SUMMARY 


CHAPTER  ONE:  FIELD  TEST  PREPARATION 
Sampling 

Campling  c  *  states  and  schools.  Five  states  were  selected  as  field  test  sites, 
on  the  basis  of  their  importance  to  success  of  the  base-year  study,  their  demographic 
heterogeneity,  and  their  representativeness  of  a  particular  region  of  the  U.S.  Two 
counties  were  chosen  within  each  state.  Fifty-two  schools  were  then  chosen  with 
probability  proportional  to  eighth  grade  enrollment  within  a  regular  public  school 
stratum  and  a  special  oversampled  private  school  stratum. 

Since  high  school  level  test  observations  were  needed  in  order  to  calibrate  the 
Cognitive  Test  Battery,  thirty  high  schools  were  also  included  in  the  sample.  High 
schools  were  chosen  with  consideration  to  their  rroximity  to  selected  eighth  grade 
schools.  Sixty  tenth  and  sixty  twelfth  grade  students  were  randomly  sampled  from  the 
eligible  students  in  each  of  the  selected  high  schools. 

Sampling  of  students.  The  next  stage  of  sampling,  selection  of  specific  students, 
took  place  soon  after  the  school  principal  informed  NORC  that  a  school  would 
participate  in  the  NELS:88  Field  Test.  NORC  requested  complete  rosters  of  all 
students  classified  as  eighth  graders  during  the  fall  term  of  the  1986-87  school  year. 
The  school  principal,  or  his  or  her  designated  representative  (the  School 
Coordinator),  was  asked  to  review  the  roster  to  identify  students  whose  physical, 
emotional  or  learning  handicaps  or  linguistic  disabilities  would  preclude 
participation  in  the  survey.  The  Coordinator  was  asked  to  classify  all  eligible 
students  as  Hispanic,  Asian-Pacific  Islander,  or  Core  (neither  Hispanic  nor  Asian- 
Pacific  Islander).  Once  the  annotated  roster  was  received  by  NORC,  Asian-Pacific 
Islanders  were  drawn  into  the  sample  at  double  their  proportional  representation  in 
the  school's  eighth-grade  population.  Hispanics  were  drawn  into  the  sample  at  the 
ratio  of  their  representation  in  the  school's  eighth-grade  population.  The  balance  of 
students  needed  to  reach  the  desired  sample  size  of  thirty-two  was  selected  from  the 
list  of  Core  students.  Approximately  ten  days  before  Survey  Day,  the  roster  was 
updated  to  reflect  transfer  students  (in  and  co  of  selected  schools).  Transfer-ins 
were  sampled  with  the  same  probabilities  as  students  who  were  included  in  the  initial 
sampling  in  that  particular  school,  so  that  the  within-school  weights  of  initially 
se'acted  sv" dents  and  selected  transfer  students  would  be  the  same. 


Securing  State/District/School  Permission 

Securing  permission  to  conduct  the  study  from  school  authorities  at  various  levels 
(state,  district,  school)  was  a  major  task  of  the  field  test.  This  process  was  shaped 
by  the  fact  that  each  individual  school  belonged  to  one  of  three  school  sectors,  each 
with  its  own  organizational  structure:  the  public  schools,  the  Catholic  school  system, 
and  non-Catholic  private  schools. 
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For  the  public  schools,  permission  was  first  sought  at  the  level  of  Chief  State 
School  Officer.  Upon  approval,  a  State  Coordinator  was  appointed.  The  Coordinator's 
role  included  three  tasks: 

-  to  maintain  liaison  between  the  project  and  the  state's  department  of 
education,  enabling  project  staff  to  keep  the  state  informed  of  the  progress  of 
the  field  test 

-  to  handle  inquiries  from  district  supervisors  concerning  state  approval  of  the 
study 

-  to  consult  with  project  staff  on  those  survey-related  problems  at  the  district 
or  local  school  that  might  require  resolution  from  the  state's  department  of 
education 

Next  permission  was  sought  at  the  district  level.  Some  problems  were  encountered 
with  gaining  district  cooperation  —  particularly  in  Dade  County,  Florida;  Los  Angeles 
County,  California;  and  Hams  County,  Texas.  Queens  County,  New  York  agreed  to 
participate  only  after  a  long  review  process  and  after  placing  restrictions  on  the 
study.  Six  of  the  districts  in  the  original  sample  refused  to  cooperate.  The  most 
common  reason  for  refusal  was  heavy  involvement  in  mandatory  testing. 

Once  district  approval  was  granted,  school  principals  were  approached.  After  some 
substitution  of  districts  and  schools  to  replace  refusals,  38  public  eighth-grade 
schools  and  19  public  high  schools  ultimately  agreed  to  enter  the  NELS:88  sample. 

For  the  private  schools,  both  Catholic  and  non-Catholic,  request  for  approval  was 
initiated  exclusively  at  the  school  level.  Substantial  difficulties  were  encountered 
in  gaining  approval  in  both  types  of  private  schools.  Reasons  for  refusal  included 
fear  of  parental  disapproval  of  the  study,  excessive  amount  of  testing  in  the  school, 
unwillingness  that  children  lose  class  time  to  non-curricular  activities,  and  the 
perception  that  too  much  work  would  be  involved  for  school  personnel.  After 
considerable  substitution,  six  Catholic  eighth-grade  schools  and  five  Catholic  high 
schools  were  brought  into  the  sample.    Seven  non-Catholic  eighth-grade  schools  and 
two  non-Catholic  high  schools  became  participants. 

Securing  Parental  Permission 

Implied  versus  explicit  permission.  Based  on  field  test  results,  an  issue  of 
major  significance  for  the  base  year  is  the  form  of  parental  permission  a  school 
requires  for  a  child  to  participate  in  NELS.88.  The  field  test  demonstrated  that  use 
of  "explicit  consent"— that  is,  requiring  a  parent  to  return  a  permission  form  whether 
or  not  the  parent  approved  of  the  child's  participation  in  the  study—was  highly 
undesirable.  Rather  than  providing  a  clear  yes/no  expression  of  parental  wishes  with 
regard  to  permission,  use  of  explicit  consent  often  resulted  in  considerable  ambiguity 
as  to  the  parents'  decision.  A  great  deal  of  expensive  follow-up  was  directed  to 
individuals  who  had  never  made  an  informed  decision  that  their  child  should  not 
participate  in  the  field  test.  We  believe  these  individuals  would  have  bean  equally 
protected  had  implied  consent— that  which  only  required  a  parent  to  return  a 
permission  form  when  denying  permission —  been  used  instead. 
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In  both  eighth-grade  schools  ?nd  high  schools,  in  all  th  ee  sector  types,  much 
effort  was  expended  in  tracking  the  explicit  consent  forms.  In  the  high  schools 
particularly,  the  proportion  of  eligible  students  participating  in  Survey  Day  was 
severely  reduced  because  Ifcrge  numbers  of  explicit  consent  forms  were  not  returned. 
Most  School  Coordinators  interpreted  non-return  of  form  as  equivalent  to  denial  of 
consent;  therefore  students  in  such  cases  were  unable  to  be  surveyed. 

Denial  of  permission  for  particular  ethnicity  groups  in  various  school  sectors. 
Another  important  field  test  finding  rented  to  permission  denials  concerns  the 
comparative  percentages  of  denial  of  th*  three  ethnicity  groups  (Hispanic,  Asian- 
Pacific  Islander,  Core)  according  to  school  sector  (Public,  Catholic,  Other  Private) 
in  the  eighth-grade  cohort.  There  were  minimal  differences  in  denial  rates  for  the 
three  ethnicity  groups  for  those  students  attending  public  and  Catholic  schools. 
However  both  Hispanic?  and  Asian-Pacific  Islanders  attending  Othor  Private  schools 
had  considerably  higher  denial  rates  (10/43  or  23.3  percent  and  3/14  or  21.4  percent) 
than  did  their  Core  ^o  jnterparts  (14/127  or  11  percent). 


RECOMMENDATIONS: 

(1)  The  State  Coordinate-  should  appoint  a  deputy  who  can  assume  the  Coordinators 

duties  wheiv  tte  latter  is  unavailable. 

(2)  District  contacting  should  be  done  early. 

(3)  Except  in  large  districts,  district  superintendents  should 

be  told  that  NORC  Will  assume  consent  to  contact  district  schools  unless  NORC  is 
informed  otherwise  within  a  stipulated  number  of  days.  In  large  districts,  the 
district  superintendent  should  be  directly  contacted  to  request  granting  of 
permission. 

(4)  The  names  of  sampled  schools  should  not  be  volunteered  jn  thw  initial  contact 

(5)  In  situations  where  di.  fricts  wish  to  know  which  schools  have  been  selected  and 
wish  to  consult  with  the  schools,  NORC  should  send  school-specific  materials  to 
the  superintendent  (to  be  forwarded  on  to  the  principal). 

(6)  When  seeking  school  approval,  telephone  follow-up  to  the  principal  should  occur 

within  a  few  days  of  the  principal's  receipt  of  the  initial  contact  letter. 

(7)  A  copy  of  the  implied  consent  form  should  be  sent  to  the  principal  with  the 

directive  that  if  the  principal  objects  to  use  of  that  form,  he  or  she  should 
contact  NORC.  (This  recommendation  is  in  response  to  the  tact  that  many 
principals  chose  to  use  explicit  consent  without  realizing  how  hard  the  tracking 
would  be.) 

(8)  In  those  schools  that  demand  explicit  consent  School  Coordinators  should  be  asked 
to  do  the  permission  tracking.  In  such  cases,  parents  should  mail  forms  to  the 
school  rather  than  to  NORC. 

(9)  Additional  contacting  materials  (containing,  for  example,  reference  to  the 

school's  uniqueness  in  the  sample)  should  be  developed  to  help  gain  cooperation 
from  religious  schools,  particularly  non-Catholic  schools.  The  latter  are  often 
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suspicious  of  federal  studies  and  have  no  centralized  authority  to  help  in  the 
persuasion  effort 


CHAPTER  TWO:  FIELD  TEST  STUDENT  DATA  COLLECTION 

The  second  chapter  of  the  Field  Test  Report  addresses  the  field  test  student  data 
collection.  First  student  completion  rates  are  examined.  Then  attention  is  given  to 
assessment  of  the  data  collection  procedures.  These  encompass  the  recruiting  and 
training  of  data  collectors,  as  well  as  the  procedures  for  conducting  the  orientation 
survey,  and  make-up  sessions. 

Student  Completion  Rates 

Overall  completion  rates,  eighth  grade.  For  all  eligible  aighth-grade  students, 
the  completion  rate  on  the  Student  Survey  was  92  percent.  By  OBEMLA  grouping,  89  9 
percent  of  the  Asian-Pacific  Islanders,  90.7  percent  of  the  Hispanics,  and  92  5 
percent  of  the  Core  students  participated  in  the  survey.  By  school  sector,  97  7 
percent  of  the  Catholic  school  students,  84.2  percent  of  the  Other  Private  school 
students,  and  92.5  percent  of  the  Public  school  students  were  surveyed. 

Impact  of  Orientation  Days  on  response  rates.  An  Orientation  Day  (O-Day)  was  held 
in  17  of  the  51  eighth-grade  schools.  An  issue  under  examination  in  the  field  test 
was  whether  orientation  sessions  would  have  a  positive  impact  on  student  participation 


Overall  completion  rates:  O-Day  versus  No  O-Day.  Of  999  eighth  grade  students 
attending  schools  that  did  not  have  an  O-Day  and  531  eighth-grade  students  attending 
schools  that  had  an  O-Day,  a  small  difference  was  found  in  rates  of  survey 
participation.  In  particular,  911  No  O-Day  cases  were  completed  (91.2  percent)  while 
497  O-Day  cases  were  registered  (93.6  percent). 

Completion  rates  of  OBEMLA  groups:  O-Day  versus  No  O-Day.    Very  little  difference 
was  found  among  completion  rates  of  the  three  OBEMLA  groups  (Hispanic,  Asian/Pacific 
Islander,  and  Core)  when  comparison  was  made  of  students  attending  No  O-Day  schools 
and  O-Day  schools.    For  each  of  the  groups,  approximately  two  percent  more  students 
weie  surveyed  in  schools  that  had  orientation  sessions  than  in  those  that  did  not. 

Completion  rates  of  school  sectors:  O-Day  versus  No  O-day.  In  looking  at  the 
effect  of  orientation  sessions,  we  also  compared  completion  rates  of  students  in  the 
various  school  sectors.  Here  the  differences  between  the  O-Day  and  No  O-Day  cases 
were  more  diverse. 


Of  170  eligible  students  attending  Catholic  schools,  116  of  117  (99  1  percent) 
attending  schools  having  no  O-Day  were  surveyed,  while  54  of  57  (94.7  percent) 
attending  schools  having  an  O-Day  were  surveyed. 

The  greatest  difference  was  found  in  the  Other  Private  population.  Of  155 
eligible  students  attending  Other  Private  schools,  111  of  138  (80.4  percent) 
attending  schools  having  no  O-Day  were  surveyed,  while  44  of  46  (95.7  percent) 
attending  schools  having  an  O-Day  were  surveyed. 
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The  smallest  difference  was  found  for  public  schools.  Of  1,083  eligible 
students  attending  public  schools,  684  of  744  (91.9  percent)  attending  schools  not 
having  O-Days  were  surveyed,  while  399  of  420  (93.2  percent)  attending  schools  having 
O-Days  were  surveyed. 

Completion  rates  by  geographic  regions:  O-Day  versus  No  O-Day.      Finally,  it  is 
of  interest  to  compare  eighth-grade  completion  rates  of  the  various  geographic  regions 
represented  in  the  field  test.  These  were  as  follows:  California  (89.4  percent), 
Florida  (94.4  percent),  Illinois  (94.3  percent).  New  York  City  (86.5  percent).  New 
York  State  excluding  New  York  City  (95.6  percent),  and  Texas  (91.5  percent). 

The  response  in  New  York  City  was  nr>  ,n  higher  than  had  been  expected.  All  three 
schools  involved  were  required  by  the  New  York  City  Board  of  Education  to  use  explicit 
consent.  It  is  important  to  note  that  the  School  Coordinators  of  all  three  schools 
made  strong  efforts  to  track  parental  permission.  Therefore  the  results  recorded  may 
give  an  overly  sanguine  picture  of  what  we  should  expect  in  the  base  year. 

An  average  of  26  students  attended  each  Survey  Day  conducted  in  an  eighth-grade 
scnool.  In  only  14  schools  (27  percent)  was  a  Make-Up  Day  required.  This  result  was 
better  than  expected. 


Data  Collection 

Performance  of  field  personnel.  Turning  next  to  the  field-test  data  collection, 
we  first  consider  the  performance  of  field  personnel  who,  in  addition  to  carrying  out 
various  preliminary  procedures,  conducted  the  orientation  sessions  and  survey 
administrations.  Professional  highly  trained  NORC  interviewers  called  Team  Leaders 
worked  together  with  Clerical  Assistants,  minimally  trained  nonprofessional  helpers 
who  were  often  friends  or  relatives  of  the  Team  Leaders. 

Debriefing  of  a  subsample  of  the  School  Coordinators  indicated  that  Team  Leaders 
performed  their  assigned  tasks  well.  According  to  those  School  Coordinators  who 
actually  attended  the  survey  administration,  the  Team  Leader  involved  with  their 
school  did  a  "great"  or  "good"  job  of  introducing  the  study  in  86.7  percent  of  the 
cases.  The  "great"  or  "good"  ratings  were  given  81.8  percent  of  the  time  for 
Enthusiasm,  71.4  percent  of  the  time  for  Keeping  Students  Interested,  75  percent  of 
the  time  for  Providing  Explanations,  and  87.5  percent  of  the  time  for  Communicating 
With  the  School  Coordinator. 

Use  of  the  Clerical  Assistant  was  an  experiment  of  the  field  test  The  main 
responsibility  of  the  Clerical  Assistant  was  to  do  the  critical  item  edit.  At  issue 
were  the  ability  of  Team  Leaders  to  hire  their  Clerical  Assistants  in  consultation 
with  their  field  managers,  the  possibility  of  locating  suitable  candidates  for  the 
Clerical  Assistant  position,  the  level  of  monetary  inducement  necessary  to  secure 
qualified  personnel,  and  the  quality  of  in-school  edit  a  Clerical  Assistant  would 
perform.  Only  in  New  York  City  did  Team  Leaders  encounter  difficulty  in  hiring  and 
keeping  Clerical  Assistants.  In  general  the  Clerical  Assistants  hired  were 
responsible  in  maintaining  confidentiality  and  did  a  good  job  (this  was  assessed  in  a 
later  edit  check)  in  performing  the  critical  item  edit.  The  daily  stipend  of  fifty 
dollars  was  apparently  sufficient  to  attract  an  appropriate  candidate. 


Implementation  of  Survey  Days.  Generally  Survey  Days  went  smoothly. 
Nevertheless,  certain  problems  were  discovered  that  will  be  corrected  for  the  base 
year.  Team  Leaders  described  the  survey  scripts  as  too  long  and  too  repetitive  in 
their  assurance  of  confidentiality.  There  was  some  difficulty  in  fitting  all  survey 
activities  within  the  limited  time  frame,  particularly  if  the  survey  session  had  to 
begin  late  for  any  reason.  The  critical-item  edit  in  particular  took  more  time  than 
had  been  anticipated.  Missing  items  were  retrie\  ed  following  the  administration  of 
the  Cognitive  Test  Battery,  if  the  session  ran  \oug,  there  was  danger  that  not  all  of 
the  needed  retrieval  would  be  done.  The  mid-session  snack,  while  extremely  popular 
with  the  respondents,  did  sometimes  delay  the  beginning  of  the  cognitive-test 
administration  since  it  took  the  students  a  while  to  settle  down  *fter  the  break. 
Such  time  allocation  problems  can  be  solved  by  malting  sure  that  students  arrive  on 
time  for  the  survey  administration. 

Implementation  of  Make-Up  Days.  Make-Up  Days  were  held  in  only  fourteen  of  the 
fifty-one  eighth-g*ade  schools,  and  in  only  six  cases  did  Team  Leaders  actu?<ly  return 
to  the  school  for  the  administration.  In  all  othar  instances  the  School  Coordinator 
administered  the  questi-  nnaire  and  Cognitive  Test  Battery,  using  instructions  given  by 
the  Team  Leader.  To  assure  confidentiality,  the  School  Coordinator  did  not  perfoim  a 
critical  item  edit  and  retrieval  of  missing  items. 

Implementation  of  Orientation  Days.  While  Orientation  Days  were  scheduled  in  a 
sample  of  twenty  eighth-grade  schools,  because  of  scheduling  difficulties,  they  were 
in  fact  only  held  in  seventeen  schools. 

Two  types  of  orientation  sessions  were  provided,  one  to  which  only  selected 
students  were  invited,  another  to  which  teachers  and  parents  were  also  invited.  Five 
of  the  twenty  schools  originally  designated  to  have  an  orientation  session  were 
invited  to  have  the  multi-audience  Orientation  Day,  but  only  two  schools  accepted  the 
invitation.  Collectively,  only  one  teacher  attended  the  multi-audience  Orientation 
Days.  Therefore,  lack  of  school,  parent,  and  teacher  interest  meant  that  no  true  test 
of  possible  effects  of  this  experimental  version  of  an  orientation  session  was 
accomplished. 

As  noted,  the  effect  on  student  participation  of  having  an  orientation  session  was 
only  marginally  positive  in  most  schools.  However,  Orientation  Days,  which  generally 
went  very  well,  did  serve  a  number  of  important  functions.  Student  schedules  were 
collected,  which  proved  extremely  helpful  for  locating  students  on  Survey  Day, 
especially  in  the  larger  schools.  Team  Leaders  were  given  an  opportunity  to  learn 
about  the  school  environment,  meet  school  personnel  and  reinforce  the  commitment  of 
principals  and  school  coordinators,  review  with  the  School  Coordinator  the  procedures 
for  Survey  Day,  assess  the  adequacy  of  the  facilities,  and  verify  the  arrival  of  NORC 
materials.  In  a  number  of  schools,  the  Orientation  Day  resulted  in  conversions  on 
denial  of  parental  permission. 

The  schools  were  surprisingly  receptive  to  having  an  Orientation  Day.  Of  44 
School  Coordinators  who  were  asked  if  they  would  be  willing  to  have  an  Orientation  Day 
if  requested,  30  responded  affirmatively. 


RECOMMENDATIONS: 


(1)  Serious  consideration  should  be  given  to  having  Orientation  Days  in  all  eighth- 

grade  schools  in  the  base  year.  Should  this  not  prove  feasible.  Orientation  Days 
should  at  least  be  planned  for  those  schools  that  might  be  problematic.  Such 
schools  include  all  that  require  explicit  consent  large  inner-city  schools,  and 
many  of  the  non-Catholic  private  schools. 

(2)  Clerical  Assistants  should  be  used.  However,  their  training  should  be  expanded. 

(3)  Procedures  should  be  revised  to  ensure  that  all  required  activities  can  be 

completed  on  time.  Scripts  used  by  the  Team  Leader  should  be  shortened. 
Special  efforts  should  be  made  to  ensure  that  all  students  arrive  at  the  test 
site  on  time. 

(4)  The  optimal  means  of  transporting  survey  materials  to  and  from  the  schools  should 

be  evaluated.  During  the  field  test  whei  U.S.  Postal  Service  First  Class 
service  was  used  for  returning  completed  questionnaires  and  tests,  two  of 
approximately  eighty  boxes  were  lost  in  the  mail.  In  addition,  there  were  long 
delays,  particularly  in  mailings  to  and  from  California. 


CHAPTER  THREE:  Ar  ALYSIS  OF  FIELD  TEST  RESULTS 
Sampling 

Two  issues  concerning  the  student  sampling  were  of  particular  interest  for  the 
field-test  analysis:  the  quality  of  sample  updating  and  the  quality  of  annotation  of 
student  rosters  for  OBEMLA  status  and  eligibility. 

Sample  updating.  The  sample  updating,  performed  at  first  by  central  office  staff 
and  later  by  Team  Leaders,  involved  calling  School  Coordinators  of  eighth-grade 
schools  ten  days  before  Survey  Day  to  acquire  a  list  of  students  who  had  transferred 
in  and  transferred  out  since  the  original  school  roster  had  been  prepared.  School 
Coordinators  were  asked  to  use  a  given  set  of  codes  to  classify  the  transfer-ins  for 
eligibility  and  ethnicity.  The  procedure  was  intended  to  assure  all  eighth-graders  in 
a  given  school  an  equal  probability  of  being  chosen  for  the  NELS:88  sample.  Transfer- 
in  students  were  sequentially  numbered  and  selected  for  inclusion  in  the  sample  based 
on  the  same  set  of  computer  generated  random  numbers  used  to  select  the  original 
sample  of  32  students. 

The  sample  updating  procedure  assumed  that  there  would  be  a  rough  symmetry,  for 
the  sample  as  a  whole,  regarding  the  number  of  transfer-ins  and  transfer-outs.  The 
ratio  of  11  selected  transfer-ins  to  65  selected  transfer-outs  clearly  contradicts 
this  assumption.  There  are  two  probable  reasons  for  this.  In  many  cases  the  original 
rosters  had  not  been  carefully  reviewed;  several  of  the  students  selected  for  the 
sample  had  in  fact  transferred  out  before  the  original  roster  was  prepared.  Perhaps 
of  greater  importance,  many  School  Coordinators  had  been  unable  to  provide  full  lists 
of  transfer-ins.  Particularly  in  schools  that  used  a  computerized  record-keeping 
system,  the  specific  date  that  a  student  had  transferred  into  the  school  was  not  a 
matter  of  record.  A  great  deal  of  manual  checking  of  lengthy  lists  would  often  have 
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been  necessary  to  produce  the  desired  information.  Therefore  there  was  probably 
substantial  undercounting  of  transfer-ins.  Such  inaccurate  updating  of  rosters 
implies  that  sampling  of  transfer-ins  was  done  using  an  inadequate  pool  of  new 
students.  Given  the  sampling  updating  procedure,  too  few  additional  students  were 
brought  into  the  sample. 

Quality  of  annotation  of  the  student  rosters.  In  general,  School  Coordinators 
undercounted  the  OBEMLA-oversample  eighth-graders  in  their  schools.  Particularly  in 
large  schools,  where  the  School  Coordinator  did  not  know  all  of  the  eighth-grade 
students,  the  quality  of  ethnic  coding  often  depended  on  the  existence  of  school 
records  that  contained  the  particular  ethnic  identities.  Since  ethnic  groupings  were 
differently  defined  across  schools,  even  weM-prepared  records  did  not  guarantee 
relevant  information.  In  some  schools,  homeroom  teachers  were  asked  to  do  the 
classification.  In  other  schools,  the  School  Coordinator  apparently  identified  the 
students'  ethnicities  largely  on  the  basis  of  last  names.  This  matter  was  further 
complicated  by  the  fact  that  in  some  districts  policy  prohibited  keeping  any  records 
classifying  students  by  ethnic  origin. 

Some  degree  of  inaccuracy— particularly  undercounting— was  therefore  to  b& 
expected.  But  comparison  of  roster  designation  with  the  student's  self-report  of  AREA 
OF  THE  WORLD  ANCESTORS  LIVED  BEFORE  COMING  TO  AMERICA  suggests  that  such  undercounting 
was  substantial.  Underidentification  of  Mexican- Americans  and  Puerto  Ricans  was 
especially  severe.  Even  after  considering  that  the  students  m*y  not  have  accurately 
responded  to  the  ethnicity  question—specifically  excluding  cases  in  which  students 
wrote  in  non-Hispanic  or  non-Asian  countries  in  Other  Hispanic  or  Other  Asian  category 
choices— the  proportion  of  underreporting  still  remains  at  one-fourth  of  the  total  for 
Hispanics,  and  much  higher  for  certain  Asian  groups,  particularly  Japanese  end 
Pacific-Islanders. 


RECOMMENDATIONS: 

(1)  Schools  likely  to  have  difficulty  annotating  student  questionnaires  should  be 
preidentified  Special  efforts  should  be  made  to  involve  teachers  in  the  review  of 
annotated  rosters. 

(2)  School  Coordinators  should  be  asked  to  keep  track  of  the  names  of  students  who 
transfer  in  from  the  date  that  the  original  roster  is  annotated  to  the  date  that  the 
sample  updating  is  requested. 


Data  Analysis  of  the  Student  Questionnaire 

The  data  analysis  of  the  Student  Questionnaire  has  seven  components,  analysis  of 
critical  item  editing  and  retrieval;  analysis  of  item  non-response;  analysis  of  inter- 
item  consistency  and  logical  consistency  of  responses  to  filter  and  dependent 
questions;  analysis  of  response  variation  by  position  in  questionnaire;  analysis  of 
cross  validation  (student  versus  parent  reports);  analysis  of  scale  reliabilities;  and 
analysis  of  item  response  variation  by  selected  student  classification  variables.  A 
brief  summary  of  the  results  of  each  analysis  follows. 


Analysis  of  critical  item  editing  and  retrieval.  Twenty-one  questions  in  the 
Student  Questionnaire  were  designated  as  critical  items  for  the  field  test.  Questions 
were  designated  critical  items  on  the  basis  of  their  centrality  to  the  policy  concerns 


of  NELS:88  and  to  the  follow-up  activities  in  1990,  their  analytic  importance,  and  the 
questionable  ability  of  students  to  answer  particular  questions.  During  the  survey 
administration,  while  the  eighth-graders  were  completing  the  Cognitive  Test  Battery, 
Clerical  Assistants  performed  an  on-the-spot  edit  of  answers  to  the  critical  item 
questions.  Team  Leaders  sought  retrieval  on  inadequately  answered  critical  items. 
Later,  an  in-house  edit  was  conducted  to  evaluate  the  editing  performance  of  the 
Clerical  Assistants.  Editors  were  asked  to  identify  two  types  of  error:  Type  A  (an 
error  with  adverse  effect  on  data  quality)  and  Type  B  (an  error  with  no  effect  on  data 
quality.)  Both  retrieval  rates  and  error  rates  informed  the  analysis  of  critical  item 
response. 

Of  single  data  element  questions,  four  questions  appeared  as 
particularly  problematic: 

(1)  L13  KIND  OF  HIGH  SCHOOL  RESPONDENT  EXPECTS  TO  ATTEND 

(2)  L21  LANGUAGE  PEOPLE  IN  RESPONDENT'S  HOME  USUALLY  SPEAK 

(3)  Q1  ANCESTKAL  DESCENT  OF  RESPONDENT  (HISPANIC  OR  ASIAN/PACIFIC  ISLANDER  OR  NEITHER 

HISPANIC  NOR  ASIAN/PACIFIC  ISLANDER) 

(4)  Q44  RESPONDENT'S  COURSES  FOR  THIS  ACADEMIC  YEAR 

Of  multiple  data  element  questions,  five  questions  registered  relatively  high 
retrieval  rates  and  three  of  these  also  registered  relatively  high  error  rates: 

(1)  LI  STUDENT'S  NAME,  ADDRESS,  AND  TELEPHONE  NUMBER 

(Apartment  numbers,  zip  codes  and  area  codes  were  responsible  for  a  considerable 
amount  of  the  retrieval.) 

(2)  L3  MOTHER'S  OR  FEMALE  GUARDIAN'S  ADDRESS  AND  TELEPHONE  NUMBER  IF  DIFFERENT  FROM 

RESPONDENT'S 

(Some  children  apparently  had  trouble  following  a  skip  pattern  embedded  in  the 
question;  otners  did  not  know  all  of  the  information.) 

(3)  L5  FATH^TS  OR  MALE  GUARDIAN'S  ADDRFSS  AND  TELEPHONE  NUMBER  IF  DIFFERENT  FROM 

RESPONDENT'S 

(The  students  often  did  not  know  the  complete  address  of  a  father/male  guardian 
who  lived  elsewhere.) 

(4)  L7  NAME,  ADDRESS,  AND  TELEPHONE  NUMBER  OF  FAMILY  FRIEND  OR  RELATIVE  (Very  often 

Clerical  Assistants  did  not  mark  this  question  group  for  retrieval  When 
retrieval  was  attempted,  children  typically  did  not  have  complete  address 
information  concerning  family  acquaintances.) 

(5)  Q9  SPECIAL  PHYSICAL  AND/OR  MENTAL  IMPAIRMENTS  OF  RESPONDENT 

(This  asked  about  special  services  students  may  have  received  owing  to  particular 
types  of  health  conditions.) 

Finally,  one  question,  while  not  requiring  substantial  retrieval,  did  produce  a 
particularly  large  number  of  errors.  This  question  asked  the  students  to  classify 
their  parents'  occupations  using  a  long  list  of  job  categories.  It  appears  that  the 
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children  did  not  know  enough  about  their  parents'  occupations  to  be  able  to  classify 
them.  A  considerable  number  of  multiple  responses  were  left  unresolved. 

The  retrieval  rate  of  all  questions  together  was  1.12  retrievals  per  case.  Five 
questions,  those  discussed  in  the  previous  paragraph,  accounted  for  54  percent  of  the 
retrievals.  Given  the  high  level  of  retrieval  this  implies,  the  Clerical  Assistants 
generally  gave  an  exemplary  performance. 

Analysis  of  item  nonresponse.    The  second  type  of  analysis  that  was  performed  on 
the  NELS:88  student  data  was  an  item  nonresponse  analysis.  Nonresponse  included  items 
the  respondent  refused  to  answer,  did  not  know  how  to  answer,  answered  with  more  than 
one  response  where  only  one  response  was  called  for,  and  failed  to  answer  at  all. 

An  item  was  selected  for  special  analysis  if  it  was  a  critical  item  and  its 
nonresponse  rate  was  equal  to  or  greater  than  5  percent;  or  it  was  not  a  critical  item 
and  its  nonresponse  rate  was  equal  to  or  greater  than  8  percent.  The  formula  used  to 
compute  the  response  rate  was: 

Response  rate  *  number  of  valid  responses  +  number  of  valid  skips 
number  of  applicable  respondents 

Among  the  items  that  emerged  as  most  problematic  by  this  criterion  were  the 
following: 

(1)  L13  KIND  OF  HIGH  SCHOOL  RESPONDENT  EXPECTS  TO  ATTEND 

(2)  Q13A  OCCUPATION  CATEGORY  OF  RESPONDENT'S  FATHER 

(3)  Q13B  OCCUPATION  CATEGORY  OF  RESPONDENT'S  MOTHER 

(4)  Q14A  HIGHEST  LEVEL  OF  EDUCATION  RESPONDENT'S  FATHER  COMPLETED 
(h)  Q14B  HIGHEST  LEVEL  OF  EDUCATION  RESPONDENT'S  MOTHER  COMPLETED 

(6)  Q27A  HOW  FAR  IN  SCHOOL  RESPONDENT'S  FATHER  WANTS  RESPONDENT  TO  GO 

(7)  Q27B  HOW  FAR  IN  SCHOOL  RESPONDENT'S  MOTHER  WANTS  RESPONDENT  TO  GO 

(8)  028  WHICH  HIGH  SCHOOL  PROGRAMS  RESPONDENT  WILL  ENROLL  IN 

(9)  Q33   HAS  RESPONDENT  TAKEN  TEST  INDICATING  APTITUDE? 

(10)  034  KIND  OF  WORK  RESPONDENT  WILL  BE  DOING  AT  AGE  30 

(11)  Q51D  USEFULNESS  OF  SOCIAL  STUDIES  IN  RESPONDENT'S  FUTURE 

(12)  Q56D  RESPONDENT'S  ATTENDANCE  IN  HEAD  START 

(13)  Q56E  RESPONDENT'S  ATTENDANCE  In  EXTENDED  DAY  CARE 

[NOTE:  The  items  listed  above,  a  sample  of  the  high  nonresponse  items,  generally  had 
nonresponse  rates  in  excess  of  20  percent  ] 
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Overall,  item  nonresponse  in  the  Main  Questionnaire  ranged  from  a 
high  of  39  percent  (Q58E,  "Did  you  go  to  extended  day  care?*)  to  lows  of  less  than  one 
percent  on  both  behavioral  and  attitude  questions  (for  example,  Question  24  on 
cigarette  smoking,  and  Question  25A,  a  self-  esteem  item),  with  an  overall  item 
nonresponse  mean  of  586  percent.  When  Don't  Knows  are  excluded  from  the  calculation, 
mean  item  nonresponse  was  4.05  percent. 

The  Field  Test  Report  considers  item-by-item  the  possible  reasons  for  high 
nonresponse  along  with  recommendations  for  item  wording  or  format  improvement. 

Analysis  of  inter-item  consistency.  There  were  several  pairs  of  parallel  items  on 
both  the  Student  and  Parent  Questionnaires.  In  each  case  questions  with  variant 
wording  attempted  to  elicit  the  same  information.  Comparisons  among  a  respondent's 
answers  to  such  related  questions  (inter-item  consistency  checks)  provide  one 
important  me«*ns  of  assessing  the  accuracy  or  quality  of  data  for  a  given  item.  If 
sucH  a  comparison  reveals  a  high  degree  of  inconsistency,  then  both  items  must  be 
closely  scrutinized  to  see  which  is  more  conducive  to  accurate  reporting  —  or 
alternative  and  more  effective  ways  of  eliciting  the  intended  information  must  be 
sought. 

Inter-item  consistency  was  analyzed  on  questions  dealing  with  two  subject  matters, 
special  education  and  orthopedic  services.  Comparisons  were  made  between  consistency 
of  answers  given  by  the  students  to  a  set  of  two  questions  on  each  of  these  topics.  In 
addition,  inter-item  consistency  checks  were  done  on  the  responses  provided  by  parents 
to  essentially  the  same  questions  appearing  in  the  Parent  Questionnaire.  Next,  cross- 
validation  was  performed  on  pairs  of  student  and  parent  responses  on  the  four  items. 
As  a  final  check,  for  a  sample  of  student-parent  cases  that  had  inconsistent  answers, 
a  telephone  validation  was  conducted  with  the  parents. 

The  results  indicate  that  on  this  kind  of  item  student  reports  are  quite 
unreliable.  Parent  response  was  more  consistent  than  student  response.  This  suggests 
thai  questions  dealing  with  the  two  subject  matters  should  be  placed  in  the  Parent 
Questionnaire  rather  than  in  the  Student  Questionnaire  in  the  base  year. 

Analysis  of  logical  consistency  of  responses  to  filter  and  dependent  questions. 
A  major  question  posed  in  the  field  test  was  whether  eighth-grade  students  would  be 
able  to  deal  with  skip  patterns  employed  in  the  survey  instruments.  Skips  are  used 
for  conditional  questions  that  require  no  answer  if  a  preceding  question  (or  "filter) 
has  routed  the  respondent  out  of  the  question.  Many  of  the  issues  under  study  in 
NELS:88  are  targeted  to  specific  populations,  and  under  these  conditions  efficiency 
considerations  make  the  use  of  skip  formats  highly  desirable.  Nevertheless,  there  are 
potential  problems  associated  with  skip  formats.  Respondents  may  skip  a  dependent 
question  they  should  have  answered  or  they  may  answer  a  question  they  should  have 
skipped.  They  may  inadvertently  skip  the  first  one  or  two  nondependont  questions 
after  dependent  questions  they  have  rightfully  skipped.  Respondents  may  develop  a 
habit  of  skipping  questions.  Questions  having  comparatively  long  context-establishing 
introductions  may  be  skipped  by  a  respondent  sensitized  to  the  legitimacy  of  skipping 
questions. 
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The  experience  of  the  field  test  suggests  that  eighth-grade  students  are  able  to 
deal  with  simple  skip  patterns.  Over  64  percent  of  the  students  were  able  to  complete 
the  survey  instruments  without  making  a  single  skip  pattern  error,  and  89.7  percent 
were  able  to  complete  the  instruments  without  making  errors  that  negatively  affected 
data  quality.  Success  in  handling  the  skip  patterns  did  not  correlate  with 
differences  in  socioeconomic  status,  nor  was  there  a  manifest  bias  against  students 
with  low  self-roported  grades.  There  was  no  correlation  between  skip  pattern  error 
and  failure  to  complete  the  survey  instruments;  data  quality  on  the  last  items  in  the 
questionnaire  did  not  suffer  because  of  the  incidence  of  skip  pattern  error 
Similarly,  nondepe..dent  questions  following  dependent  questions  did  not  register 
inordinately  high  levels  of  nonresponse. 

Analysis  of  response  variation  by  position  in  questionnaire.     The  field  test 
provided  an  opportunity  to  assess  questionnaire  length  and  its  effect  on  data  quality 
One  way  to  conduct  such  an  investigation  is  to  measure  and  evaluate  the  degree  of 
degradation  in  response  quality  for  the  final  questionnaire  items.  Response  quality 
may  be  degraded  in  at  least  two  different  ways.  First,  questions  positioned  later  in 
the  questionnaire  may  simply  remain  unanswered  by  students  who  found  the  questionnaire 
too  long.  Second,  the  care  and  attention  students  give  to  items  near  the  end  of  the 
huSedlyna're        deC"ne;  students  rnaV  either  skip  some  questions  or  answer  questions 

/  group  of  closed-ended  items  at  the  beginning  of  the  Student  Questionnaire  was 
compared  to  a  group  of  closed-ended  items  at  the  end  of  the  questionnaire.  Percentage 
of  illegitimate  blanks  (those  not  made  in  response  to  a  valid  skip)  was  the  criterion 
used  as  the  indicator  for  the  first  behavior  described  above.  Nonresponse  rate 
(figuring,  besides  blanks,  also  multiple  responses  and  Don't  Knows)  was  used  to  assess 
deterioration  of  attention. 

The  differences  in  the  mean  and  median  percentage  of  blanks  and  the  median 
nonresponse  rates  for  the  two  groups  is  small  enough  to  conclude  that  data  quality  for 
the  latter  items  is  not  appreciably  affected  by  their  placement  at  the  conclusion  of 
the  survey  instruments. 

Cross-validation:  student  versus  parent  reports  (socioeconomic  status  and  early 

educational  experience).  Student-parent  mmp-H^K  in       npnflnr  in  :ovornl  1 

sections  of  the  field  test  report.  In  verification  of  ethnicity  (OBEMLA  sample 
status),  parent-student  ethnic  reports  are  compared.  In  the  section  on  inter-item 
consistency,  parent-student  handicap  program  reports  are  contrasted.  In  the  section 
on  student  dispersal  and  tracking,  student-parent  expectations  as  to  high  school  to  be 
attended  in  1990  are  compared.  We  have  supplemented  these  discussions  by  reporting  on 
two  classes  of  items  —  SES  indicators,  and  early  school  and  pre-school  programs  — 
that  asked  identical  questions  of  parents  and  students. 

Socioeconomic  status  has  long  been  recognized  as  one  of  the  most  important 
predictors  of  educational  outcomes  and  personal  and  social  development.  Because  of 
the  centrahty  of  the  SES  variable  to  descriptive  and  analytic  studies,  it  is 
extremely  important  that  data  quality  support  the  construction  of  a  reliable  and  valid 
SES  measure.  In  order  to  gauge  the  quality  of  student  SES  responses,  we  compared 
student  SES  responses  to  parent  SES  responses. 
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For  purposes  of  the  comparison,  we  constructed  an  SES  index  from  a  standardized 
equally  weighted  combination  of  father's  education,  mother's  education,  father's 
occupation,  and  mother's  occupation,  income  was  omitted  from  consideration  as  there 
was  no  income  question  on  the  student  Questionnaire.  "Household  items"  was  omitted 
from  consideration  as  there  was  no  household  items  question  on  the  parent 
questionnaire.  (However,  we  also  compared  SES  Index  results  wf'th  student  household 
items  reports  and  parent  income  reports.)  As  a  check  on  the  accuracy  of  the  SES  index 
comparison,  we  also  crosstabulated  parent  and  student  responses  to  the  four  data 
elements  of  the  composite. 

The  results  of  the  individual  crosstabulations  reveal  substantial  disagreement 
between  parent  and  student  responses:  Some  393  of  775  parent  cases  could  be  matched 
with  student  cases  on  father's  education.  Of  these,  41  percent  disagreed.  Of  420  of 
775  matchable  cases  on  mother's  education,  43  percent  disagreed.  Similarly,  440  of 
775  parent  cases  could  be  matched  with  student  cases  on  father's  occupation  and  44 
percent  of  these  disagreed.  Of  389  of  775  matchable  cases  on  mover's  occupation  46 
percent  disagreed. 

We  calculated  composite  SES  scores  for  both  the  parent  and  the  student.  Then,  on 
the  basis  of  the  student  SES  distributions,  we  divided  these  scores  into  three  f/roups, 
corresponding  to  high,  medium  and  low  SES.  We  then  crosstabulated  the  thr^-group  SES 
composites  constructed  from  the  parent  and  student  data. 

Overall,  we  found  that  parents  confirmed  student  reports  of  low  SES  77.7  percent 
of  the  time,  that  they  confirmed  student  reports  of  middle  SES  71.7  percent  of  the 
time,  and  corroborated  student  reports  of  high  SES  60.6  percent  of  the  time. 
Additionally,  it  should  be  noted  that  many  of  the  student  occupation  and  education 
data  were  missing.  Moreover,  examination  of  a  subsample  of  student  questionnaires 
that  did  have  the  relevant  occupation  data  revealed  that  students'  answers  to  open- 
ended  questions  asking  the  parents'  occupations—which  we  ourselves  coaed— had  *  low 
level  of  agreement  with  the  occupation  codes  chosen  by  the  students.  When  we 
constructed  SES  «-ut  of  alternative  measures  (the  student-supplied  household  items  data 
and  the  parent-supplied  income  data),  we  found  that  these  had  a  better  correlation 
with  the  parental  SES  composite  than  with  the  student  SES  composite. 

In  examining  high  nonresponse  items  on  the  student  questionnaire,  we  found  that 
the  individual  elements  of  the  multiple  question  that  asked  about  various  very  early 
instructional  and  pre-instructional  programs  the  student  might  have  attended  often  had 
problematic  response  rates.  The  parents  were  asked  the  same  set  of  questions  in  the 
Parent  Questionnaire.  Comparison  of  those  student-parent  cases  for  which  sets  of 
answers  were  present  revealed  substantial  disagreement  between  parents  and  student;  on 
these  items.  In  particular,  the  students  often  marked  the  Don't  Know  response,  while 
parents  seldom  used  that  answer.  All  in  all,  it  appears  that  parents  are  better  data 
sources  for  questions  about  early  childhood  instructional  and  pre-instructional 
programs  than  are  eighth-graders. 


Analysis  of  scale  reliabilities.  Two  attitude  scales,  internal  versus  external 
locus  of  control  and  self-esteem,  were  incorporated  into  the  Student  Questionnaire 
At  issue  was  the  reliability  of  these  scales,  that  is,  the  ability  of  scale  items 
collectively  and  alone  to  elicit  consistent  responses  reflective  of  the  particular 
attitude  stances  upon  repeated  asking  of  the  questions. 
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The  p  rformance  of  these  attitude  items  must  be  scrutinized  especially  closely. 
The  two  scales  in  their  c  rrent  form  are  importantly  different  f^om  the  comparable 
N  #-72/HS&B  sea  as.  Untested  items  have  been  added  and  itens  have  been  rewritten. 
Even  without  these  changer  it  would  be  necessary  to  examine  the  performance  of  these 
scales  with  eighth  graders. 

A  statistical  i  .easure  of  reliability  that  is  routinely  applied  to  scales  is 
Cronbath's  alpha  or  coefficient  alpha.  Overall,  the  reliability  coefficient  alpha  for 
the  self-esteem  scale  was  .82,  and  for  the  locue  of  control  scale  .60.  cor  comparison 
purposes,  the  reliability  coefficient  alphas  for  the  HS&B  and  NLS-72  scales  were 
somewhat  lower,  .66  for  the  self-esteem  composite  and  .56  for  locus  of  control.  One 
cannot  however,  legitimately  generalize  to  probable  coefficient  alphas  for  the  two 
scales  in  the  bast  /ear  since  the  field-test  sample  was  a  small  nonprobability  sample. 
Even  so,  one  can  employ  the  item-to-total  correlation  to  identify  particular  items 
ti.at  either  add  minimally  to  the  reliability  of  the  scale  or  actually  detract  from  the 
reliability.  The  Field  Test  Report  identifies  several  such  items. 

Analysis  of  incidence  of  item  nonresponse  by  selected  respondent  characteristics. 
Pronounced  variations  in  nonresponse  that  correlate  with  common  or  defining  features 
of  groups  have  possible  implications  for  the  evaluation  and  revision  of  the  student 
questionnaire.  For  this  reason,  crosstabulations  wore  made  of  item  responses  on 
eleven  questions  (ten  of  which  had  high  nonresponse)  with  a  variety  of  standard 
student  classification  variables.  The  questions  examined  addressed  the  student's 
future  school  program,  parental  contact  with  the  school,  parental  aspirations  for  the 
student's  education,  aptitude  testing  of  the  student,  and  the  student's  pre-first 
grade  school  experience.  The  classification  variab'es  included  School  Sector,  Sex, 
Race,  Ethnicity,  Academic  Track,  Grades,  SES  (student  ser  e),  SES  (parent  scale), 
Urbanicity,  and  Pattern  of  Early  Language  Acquisition. 

Judging  from  selected  high  nonresponse  items,  it  appears  that  respondent 
characteristics  did  not  have  a  strong  and  pervasive  effect  on  item  performance  in  the 
field  test  student  questionnaire.  However,  for  many  of  the  high  nonresponse  items  in 
which  statistically  significant  differences  were  observed  among  groups  (notably 
Academic  Track,  Grades,  and  Race  groups),  all  groups  experienced  some  difficulty  with 
answering  the  item  (that  is,  one  group  did  not  generally  answer  the  question  well, 
while  the  others  answered  the  question  poorly).  The  differences  observed  often 
indicated  that  questions  which  create  difficulty  for  all  students  might  be  more 
difficult  for  students  in  lower  academic  tracks  or  with  lower  grades  thar>  for  students 
in  higher  academic  tracks  or  with  higher  grades. 

On  t oasis  of  this  analysis  of  selected  high  nonresponse  items,  some  question 
revisions  are  suggested  while,  in  other  cases,  differences  in  student  performance  may 
poin.  to  differences  in  knowledge  and  experience  of  the  different  groups. 


RECOMMENDATIONS: 

(1)  Wherever  feasible,  eighth-grade  students  should  not  be  asked  to  provide 

information  that  is  more  accurately  provided  by  another  NELS:88  respondent  In 
particular,  eighth-graders  should  not  be  asked  to  classify  parental  occupation, 
assess  their  participation  in  pre-first  grade  educational  programs  or  programs 
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for  treatment  of  physical  or  mental  hardicapsff  or  classify  their  parents'  level 
of  education.  (Consideration  might  be  given  to  having  students  fill  in  an  open- 
ended  question  asking  the  parental  occupation  since,  in  the  field  test  the 
students  were  fairly  successful  in  answering  such  a  question.) 

(2)  Instructions  must  be  made  clear  to  students  (for  example,  routing  arrows  should  be 

provided),  but  sequences  of  questions  requiring  skip  patterns  should  be  retained. 

(3)  Items  in  the  Student  Questionnaire  should  be  appropriately  revised  if  analysis 

suggests  that  high  nonresponse  involving  the  item  has  occurred  because  of 
weakness  in  format  question  order,  wording,  questionnaire  instructions,  or  other 
difficulties. 


Analysis  of  Field  Test  Results  on  the  Cognitive  Test  Battery 

The  Educational  Testing  Service  (ETS)  is  constructing  the  Cognitive  Test  Battery 
of  NELS:88  to  assess  the  extant  and  correlates  of  cognitive  growth  in  rending, 
mathematics,  science,  and  social  studies  as  students  move  from  grade  eight  to  grade 
twelve.  A  secondary  purpose  of  the  NELS:88  Test  Battery  is  to  provide  a  common  scale 
such  that  comparable  HS&B  cohorts  can  be  compared  on  a  cross-sectional  basis  with  the 
NELS:88  cohort  in  the  area  of  mathematics  and  possibly  reading. 

Two  field  test  forms  were  constructed—Form  A  and  Form  B.  Form  A  included  50 
items  for  the  reading  test  and  42  items  for  the  Science  test.  Form  B  included  82 
items  for  the  Mathematics  test  and  60  items  for  the  Social  Studies  test 
Approximately  half  of  the  NELS:88  field  test  students  in  each  of  three  jrade  levels- 
eighth,  tenth,  and  twelfth  —received  Form  A,  while  the  other  half  received  Form  B. 

In  the  NELS:88  base  year,  only  approximately  85  minutes  will  be  available  for  the 
cognitive  testing.  Given  these  limitations,  four  relatively  short  tests  were 
constructed  from  the  field  test  item  pool.  A  preliminary  choice  of  20  reading  items, 
40  mathematics  items,  30  social  studies  items,  and  25  science  items  have  been 
selected.    Selection  criteria  include  apparent  difficulty  of  the  item  (as  measured  by 
overall  correct-response  rate);  contribution  to  reliability  of  the  particular  academic 
area  scale;  presence  in  a  cluster  of  items  representing     j  specific  step  in  a  skill- 
level  hierarchy;  and  success  of  item  in  measuring  change  (as  measured  by  divergence  of 
means  of  correct  responses  at  the  three  grade  levels). 

Small  contrasts  of  mean  scores  across  tenth  and  twelfth  grades  indicated  that  for 
two  of  the  four  subject  matters—mathematics  and  reading—  two  test  forms  should  be 
provided,  one  for  eighth  and  tenth  graders  and  another  for  twelfth  graders.  That  is, 
questions  demonstrating  a  higher  skill  level  should  be  placed  in  the  twelfth-grade 
questionnaire  to  better  distinguish  cognitive  growth  between  the  tenth  and  twelfth 
grades.  The  social  studies  test  did  show  sufficient  difference  in  means  for  tho  three 
grades.  In  addition,  no  floor  or  ceiling  effects  were  present:  that  is,  means  for 
eighth-graders  were  not  particularly  low  and  means  for  twelfth-graders  were  not 
excessively  high.  On  this  basis,  it  has  been  decided  to  have  a  single  form  of  the 
social  studies  test  for  all  grade  levels.  Test  results  on  the  science  test  were 
inconclusive.  While  it  initially  appears  that  a  single  version  of  the  science  test 
for  all  grade  levels  may  be  appropriate,  further  investigation  is  indicated  before  the 
decision  is  made  concerning  the  final  fo.m(s). 
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Finally,  it  should  be  reported  that  in  spite  of  being  relatively  short,  the 
Preliminary  forms  of  the  Reading,  Mathematics,  and  Social  Studies  tests  exhibited 
,  iite  good  raitebiltties.  The  reliabilities  of  the  NELS  Reading  and  Mathematics  tests 
compare  favorably  with  those  achieved  on  similar  tests  used  in  HS&B.    Any  comparison 
of  reliability  between  the  HS&B  and  NELS  Social  StuJies  tests  is  suspect  as  the  two 
sets  of  tests  differ  greatly  with  respect  to  numbers  of  items  included. 


CHAPTER  FOUR:  THE  PARENT  SURVEY 

Data  Collection  of  the  Parent  Survey 

Sampling.  Thirty-four  of  the  51  eighth-grade  schools  were  selected  to 
participate  in  the  field  test  of  the  NELS:88  Parent  Survey.  To  assure  adequate 
representation  of  private  schools,  all  sampled  private  eighth-grade  schools  were 
designated  to  have  the  parent  study.  Schools  located  in  areas  with  heavy  student 
survey  activity  comprised  the  balance  of  the  parent  sample  institutions.  One 
parent/guardian  of  each  of  the  selected  eighth-grade  students  in  the  34  schools  was 
made  a  respondent  in  the  study. 

Delivery  of  Parent  Questionnaires.   All  parents  received  the  Parent 
Questionnaire  in  a  packet  that  also  contained  a  letter  introducing  the  study  to  the 
parent  and  a  postage-paid  envelope  for  return  of  the  questionnaire  to  NORC.  Three 
different  methods  were  used  to  deliver  the  questionnaires  to  parents:  Student  Take 
Home,  School  Mail,  and  Central  Office  Mail.  An  important  experiment  of  the  field  test 
was  to  test  the  relative  effectiveness  of  the  Take  Home  and  Mail  treatments  according 
to  the  following  criteria: 

-  degree  of  remailing  required 

-  short-term  and  longer-term  parent  response  rates 

-  quantity  and  quality  of  response  to  selected  critical  items. 

Student  Take  Home— the  method  that  had  students  carrying  the  questionnaires  home 
to  their  parents  on  the  day  that  the  students  themselves  were  surveyed—emerged  as  a 
superior  method  for  maximizing  parent  participation. 

Criterion  1:  degree  off  ma  ling  required.  Regarding  the  first  of  the  three 
criteria,  remailings  made,  Student  Take  Home  showed  34  of  397  (8.6  percent) 
remailings,  while  School  Mail  showed  15  of  156  (9.6  percent)  and  Central  Office  Mail 
showed  26  of  244  (10.7  percent).  This  evaluation  encompasses  a  subset  of  total  parent 
cases,  specifically  those  in  which  students  were  surveyed  and  no  particular 
complications  in  parent  questionnaire  delivery  were  encountered. 

Criterion  2:  short-term  and  long-term  response  rates.   With  regard  to  the  second 
criterion,  early  and  late  participation  rates,  Student  Take  Home  consistently  emerged 
as  more  effective  than  Central  Office  Mail.  (School  Mail  was  used  in  only  five 
schools.  It  was  used  when  the  school  refused  to  provide  parent  address  information 
that  was  necessary  for  the  Central  Office  Mail  treatment.) 
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At  three  weeks,  the  time  at  which  telephone  prompting  of  outstanding 
questionnaires  was  scheduled  to  begin,  53.3  percent  of  the  Student  Take  Home 
questionnaires  and  47.7  percent  of  tho  Central  Office  Mail  questionnaires  were  in 
t  house.  (This  analysis  encompasses  the  same  set  of  cases  examined  in  the  remailing 

analysis.) 

By  May  10th,  the  cut-off  date  for  data  entry  of  questionnaires,  a  total  of  775 
questionnaires  were  processed.  Considering  all  parents  of  children  eligible  to 
participate  in  the  Student  Survey,  363  of  440  (82.5  percent)  of  Student  Take  Home 
parents  had  completed  parent  questionnaires,  while  279  of  402  (69.4  percent)  of 
Centra!  Office  Mail  parents  had  participated  in  the  Parent  Survey.  Completion  rates 
were  then  figured  using  a  second  formula,  which  considered  a  base  of  only  parents  of 
children  who  had  actually  participated  in  Survey  Day.  This  calculation  was  of 
interest  since  parents  of  children  who  had  not  participated  in  the  Student  Survey  were 
not  subject  to  Central  Office  and  field  follow-up  on  unreturned  questionnaires.  Here 
365  of  415  (88  percent)  of  Student  Take  Home  questionnaires  were  in,  while  274  of  363 
(75.5  percent)  of  Central  Office  Mail  questionnaires  had  been  received. 

Criterion  3:  Quality  and  Quantity  of  Information  Provided.  By  the  third 
criterion,  quality  and  quantity  of  information  provided,  Student  Take  Home  again 
emerged  as  distinctly  superior.  The  first  609  parent  questionnaires  that  arrived  in 
house  were  subject  to  retrieval  on  critical  items.    Telephone  calls  were  made  to 
parents  if  inadequate  answers  were  provided  to  selected  important  items  on  the 
questionnaire. 

Two  of  the  most  personal  critical  items  addressed  locator  information  on  the 
parent  respondent  (name,  address,  and  telepi  one  number)  and  the  amount  of  the  family's 
annual  income.  These  two  questions  were  chosen  as  the  quality/quantity  indicator  for 
three  reasons: 

-  the  questions  represent  two  different  types  of  sensitivity 

-  both  questions  had  high  retrieval  rates 

-  it  seemed  plausible  that  respondents  could  vary  in  their  willingness  to  respond 
to  these  questions  according  to  the  manner  in  which  they  received  a  parent 
questionnaire. 

Of  296  Student  Take  Home  cases  considered,  18  (6.2  percent)  initially  did  not 
provide  Respondent  Locator  information  and  34  (11.5  percent)  did  not  provide  Family 
Income  Information.  Of  177  C  >.«tral  Office  Mail  cases  considered,  20  (11.3  percent) 
initially  did  not  provide  Respondent  Locator  Information  and  41  (23.2  percent)  did  not 
provide  Family  income  Information. 


Completion  Rates  for  the  Parent  Survey 

Overall  completion  rates.    Given  the  very  short  time  span  of  the  Parent  Survey- 
approximately  three  and  a  half  months  with  students  surveys  being  stagaered  over  the 
first  two  months—the  parent  participation  rates  achieved  were  encouraging.  A 
subsample  of  the  Parent  Survey  schools,  generally  those  that  had  Survey  Days  in  the 
first  six  weeks  of  the  field  period,  were  subject  to  a  full  menu  of  follow-up  efforts 
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as  needed:  a  thank  you/reminder  postcard,  a  telephone  prompt  call,  a  telephone 
interview  attempt  and  a  personal  interview  attempt.  For  the  18  schools  that  were 
subject  to  the  full  follow-up  treatment  the  final  participation  rate  for  those 
parents  whose  children  were  eligible  to  participate  in  the  Student  Survey  was  476/562 
or  84.7  percent  The  final  participation  rate  for  these  same  18  schools  using  parents 
of  surveyed  eighth-graders  as  the  base  was  476/517  or  92.1  percent.  When  one 
considers  the  full  sample,  including  schools  that  had  minimal  follow-up  (in 
particular,  schools  with  Survey  Days  in  the  final  weeks  of  the  Student  Survey  period 
and  New  York  City  public  schools  where  no  telephone  or  personal  follow-up  was 
allowed),  the  Eligible  Student  base  parent  participation  rate  was  780/999  or  78.1 
percent  while  the  Surveyed  Student  base  parent  participation  rate  was  770/922  or  83.5 
percent. 

Specific  Completion  Rates.    While  overall  the  rate  of  participation  in  the  Parent 
Survey  was  strong,  for  some  specific  groups  the  extent  of  participation  was  relatively 
weak.  Comparisons  were  made  of  parent  participation  using  these  groupings:  Ethnicity 
(OBEMLA  status);  School  Sector  (Public,  Catholic,  Other  Private);  and  Permission  Type 
Required  (Explicit,  Implied). 

Participation  rates:  Ethnicity.  The  findings  on  the  ethnicity  comparison  were 
gratifying  in  that  they  do  not  confirm  our  fear  that  the  Hispanic  and  Asian/Pacific 
Islander  parents  would  register  low  participation  due  to  language  barriers  or  cultural 
characteristics.  Nor  do  they  lend  support  to  the  view  that  the  studyls  aims  could  be 
harmed  by  failing  to  provide  a  Spanish-language  edition  of  the  Parent  Questionnaire  in 
the  base  year.  Under  the  Eligible  Student  calculation,  Hispanic*  reached  81.7  percent 
participation  (152/186),  while  Asian/Pacific  Islanders  reached  77.2  percent  (61/79) 
and  the  Core  g-oup  reached  76.5  percent  (562/735).  Under  the  Surveyed  Student 
calculation,  Hispanics  reached  90  percent  completion,  while  Asian/Pacific  Islanders 
and  the  Core  group  respectively  reached  84.7  percent  and  80.1  percent. 

Participation  rates:  School  Sector.   Participation  rates  of  parents  of  children 
who  respectively  attended  Catholic,  Other  Private,  and  Public  schools  differed 
dramatically.  Under  the  Eligible  Student  calculation,  90.2  percent  (157/174)  of  the 
Catholic  school  parents,  62.5  percent  (95/152)  of  the  Other  Private  school  parents, 
and  77.6  (522/673)  percent  of  the  Public  school  parents  participated  in  the  Parent 
Survey.  Considering  Surveyed  Student  parents,  91.8  percent  (156/170)  of  Catholic 
school  parents,  67.6  percent  (94/139)  of  Other  Private  school  parents,  and  83.6 
percent  514/615)  of  Public  school  parents  completed  questionnaires.  This  result 
suggests  that  special  attention  needs  to  be  given  in  the  base  year  to  convincing 
parents  of  children  who  attend  non-Catholic  private  schools  of  theii  importance  to 
NELS:88. 

Participation  rates:  Permission  Type.    Throughout  the  Student  Survey,  use  of 
explicit  parental  consent  for  student  participation  in  NELS:88  proved  costly  both  in 
terms  of  student  participation  and  personnel  effort.  From  the  results  obtained  in 
comparing  parent  completion  rates  of  schools  that  required  respectively  explicit  and 
implied  consent,  it  would  seem  that  weak  parent  participation  is  also  correlated  with 
school's  use  of  explicit  consent.  Under  the  Eligible  Student  calculation,  70.8 
percent  (208/295)  of  the  Explicit  Consent  parents  and  81.1  percent  (522/644)  of  the 
Implied  Consent  parents  completed  the  Parent  Survey.  Under  the  Surveyed  Student 
calculation,  78.5  percent  (208/265)  of  the  Explicit  Consent  parents  and  85.3  percent 
(512/600)  of  the  Implied  Consent  parents  were  surveyed. 
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Participation  rates:  New  York  City  Public  Schools.   The  New  York  City  public 
schools  posed  a  particular  challenge  for  the  NELS:88  Parent  Survey.  The  New  York  City 
Board  of  Education  imposed  several  restrictions  on  how  the  Parent  Survey  could  be 
conducted  in  its  three  schools: 

-  NORC  was  not  permitted  to  seek  telephone  contact  with  the  students'  parents  in 
order  to  prompt  return  of  questionnaires. 

-  No  telephone  or  personal  interviewing  was  allowed  except  at  the  request  of  the 
parent. 

-  However,  NORC  was  given  permission  to  carry  out  any  type  of  reasonable  written 
follow-up. 

Initial  response  from  the  New  York  City  parents  was  very  weak.  Consequently,  a 
remailing  was  done  on  all  outstanding  cases.   A  new  copy  of  the  questionnaire,  the 
original  parent  letter  a  special  written  prompt  letter  and  a  postage-paid  return 
envelope  were  sent  to  the  best  possible  address  that  was  available  for  the  student. 
Investigation  had  revealed  that  the  parent  addresses  that  the  New  York  City  Board  of 
Education  had  provided  to  NORC  often  differed  substantially  from  those  the  students 
cited  in  the  locator  pages  of  the  Student  Questionnaire.  The  new  parent  packets  were 
mailed  to  the  address  the  student  provided  when  such  discrepancies  existed. 
Nevertheless,  some  seven  weeks  after  the  last  school's  Survey  Date,  only  one  of  the 
three  schools  had  a  higher  than  50  percent  Eligible  Student  completion  rate  (54.8 
percent)  or  Students  Surveyed  completion  rate  (58.6  percent).  This  result  strongly 
supports  a  need  for  easing  of  restrictions  for  the  base  year. 

Implementation  of  the  Parent  Survey.  In  general,  the  Parent  Survey  proceeded 
smoothly.  Many  efficiencies  were  found  in  having  the  retrieval  and  prompting  work 
done  at  the  NORC  central  office,  not  least  of  which  was  the  rapidity  with  which 
updating  of  questionnaire  status  could  be  accomplished.  However,  comparison  of 
interviewing  accomplishments  of  central  office  telephone  interviewers  and  field 
personal  interviewers  suggest  that  both  telephone  interviewing  and  personal 
interviewing  might  best  be  done  by  the  field  interviewers  in  the  base  year.  While  the 
average  quality  of  the  interviews  obtained  was  approximately  equal  for  the  two 
interviewer  groups,  field  interviewers  seemed  particularly  adept  at  obtaining 
interviews.  Too,  they  often  were  successful  in  locating  respondents  who  had  no 
telephones. 


RECOMMENDATIONS: 

(1)  To  the  greatest  extent  possible.  Parent  Questionnaires  should  be  delivered  to 

parents  by  the  sample  eighth-graders,  rather  than  by  mail. 

(2)  For  the  Parent  Questionnaire  Follow-Up,  serious  consideration  should  be  given  to 

having  NORC  central  office  interviewers  conduct  only  the  retrieval  and  telephone 
prompting  functions.  Field  interviewers  would  then  do  both  the  telephone  and 
personal  interviewing. 

(3)  tt  should  be  decided  whether  a  telephone-interview  version  of  the  Parent 

Questionnaire  is  desirable. 
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(4)  Efforts  should  be  made  to  enhance  participation  rates  of  parents  whose  children 
attend  Other  Private  schools  and  New  York  City  public  schools.  For  example,  in 
the  former  case,  appeals  should  be  made  with  reference  to  uniqueness  of  the 
school  type  in  the  NELS  sample  in  the  latter  case,  multi-language  contacting 
materials  should  be  provided. 

(5)  Requests  should  be  made  to  the  New  York  City  Board  of  Education  to  ease 

restrictions  concerning  permitted  means  of  conducting  Parent  Questionnaire 
follow-up  in  New  York  City  public  schools. 


Analysis  of  the  Parent  Questionnaire 

The  primary  purpose  of  the  Parent  Questionnaire  was  to  collect  information  from 
parents  that  they  are  in  the  best  position  tc  provide  about  factors  that  influence 
educational  attainment  and  participation.  Such  information  includes  family  structure 
and  background;  and  parents  attitudes  toward  aspirations  concerning,  tnd 
participation  in  the  schooling  of  the  targeted  child.  The  questionnaire  also 
collected  information  that  would  enable  follow-up  in  future  years. 

Since  a  guiding  philosophy  in  the  development  of  an  the  NELS:88  questionnaires 
was  to  obtain  information  from  the  most  closely  associated  and  accurate  sources  rather 
than  asking  for  information  from  a  secondary  and  potentially  less  accurate  source,  the 
important  family  income  question  was  placed  on  the  Parent  Questionnaire.  This 
question  is  also  highly  sensitive—but  perhaps  is  made  less  sensitive  when  placed  in 
the  context  of  educational  financial  planning  items,  which  point  to  the  clear 
relevance  for  research  purposes  of  the  income  item.  Other  important  but  sensitive 
questions— such  as  religious  affiliation— were  also  placed  in  the  Parent 
Questionnaire. 

As  is  the  case  for  the  Teacher  and  School  Questionnaires,  the  object  of  the  Parent 
Questionnaire  is  to  collect  reliable  and  valid  data  to  be  used  primarily  in  the 
analysis  of  student  behaviors  and  outcomes,  and  only  secondarily  as  a  data  set  by 
itself.  To  fulfill  this  purpose,  one  parent  (or  guardian)  of  each  selected  eighth- 
grade  student  in  the  base  year  will  be  recruited  to  participate  in  the  study.  In  the 
field  test,  cover  letters  and  other  printed  materials  directed  the  Parent 
Questionnaire  to  the  parent  or  guardian  who  knows  most  about  the  student's  educational 
activities  and  home  educational  support  system 

The  intended  response  burden  of  the  field  test  instrument  was  40  minutes.  From 
the  pool  of  items  tested  in  the  field  test,  a  selection  of  the  most  important  of  these 
items  will  form  the  basis  for  a  questionnaire  of  approximately  30  minutes  length  in 
the  base  year. 

Analysis  of  field  test  Parent  Questionnaire  data  provides  a  basis  for  evaluating 
the  parent  instrument  ana  the  extent  to  which  the  data  gathered  will  fulfill  the 
purposes  of  the  study  design.  Important  findings  include  the  following: 

Overall  response  rates  to  critical  items  were  acceptable.  With  few  exceptions,  at 
least  95  percent  of  the  respondents  provided  the  information  requested  and  followed 
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skip  patterns  correctly.  Exceptions  have  been  identified  and  form  the  basis  of 
specific  recommendations  in  the  body  of  the  report.  The  high  nonresponse  items  asked 
for  the  respondents  educational  expectations  for  the  child,  information  about  who 
(speclfice'ly)  is  home  when  the  child  returns  from  school,  and  information  about 
family  Income.  The  nonresponse  rate  for  income,  though  high,  was  not  as  high  as 
expected.  Although  nonresponse  was  comparatively  high  for  parental  education,  parent 
reports  showed  better  response  than  student  reports  on  the  identical  subject  matter. 
Parents  were  also,  not  surprisingly,  far  better  able  to  report  parent  occupations  than 
were  students. 

Response  was  also  variable  to  some  parts  of  the  request  for  locator  information 
(the  closer  the  relationship  of  the  respondent  to  the  individual  on  whom  information 
is  requested,  the  more  likely  it  is  that  the  information  is  provided)  and  the  question 
about  where  the  child  is  expected  to  attend  high  schoc1— which,  incidentally,  was 
better  answered  by  the  eighth-graders. 

Response  rates  to  noncritical  items  were  .generally  acceptable,  with  some 
exceptions.  Recommendations  are  made  in  the  full  report  about  revisions  to  sorr.o  of 
the  items  and  elimination  of  others.  Nonresponse  on  the  sensitive  religious 
preference  item—which  was  not  a  critical  item  and  hence  was  not  retrieved— was  low 
(below  five  percent.) 

The  overall  high  individual  and  item  response  rates  and  anecdotal  evidence  point 
to  the  fact  that  the  approximately  forty  minute  questionnaire  was  not  perceived  as 
burdensomely  long.  This  is  not  surprising,  given  the  salience  of  the  topic—the 
child's  educational  experience — to  most  parents. 

The  instruction  that  the  questionnaire  be  completed  by  the  parent  or  guardian  most 
familiar  with  the  child's  educational  situation  apparently  caused  no  confusion  among 
respondents.  Nearly  three-quar*ers  of  the  time,  the  Parent  Questionnaire  was 
completed  by  the  mother.  The  fact  that  it  was  completed  by  the  father  18  percent  of 
the  time  and  by  others  (stepfathers,  grandparents,  other  guardians)  in  the  balance  of 
instances  points  to  a  substantial  minority  of  non-maternal  respondents.  This  supports 
the  notion  that  predesignation  of  the  mother  as  respondent  should  not  be  preferred  to 
the  field  test  policy,  which  left  choice  of  respondent  open  to  the  family's  judgment 
as  to  who  could  best  answer  the  questions. 


CHAPTER  FIVE:  FIELD  TEST  RESULTS  OF  THE  SCHOOL  AND  TEACHER  SURVEYS 
Introduction 

The  school  principals  of  each  of  the  51  NELS:88  eighth-grade  schools  were  asked  to 
complete  the  NELS:88  School  Questionnaire,  while  two  teachers  of  each  sample  eighth- 
grader  were  reauested  to  respond  to  the  NELS:88  Teacher  Questionnaire.  The  School 
Survey  and  the  Teacher  Survey  were  both  designed  and  administered  by  Westat. 

The  primary  purpose  of  the  School  Survey  is  to  identify  general  descriptive 
information  about  each  participating  eighth-grade  school  regarding  the  school's 
student  population,  teaching  staff,  policies,  program  offerings,  and  overall 
educational  climate  as  perceived  by  the  school  principal.  Information  obtained 
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through  the  administration  of  the  School  Questionnaire  is  intended  to  assist  in 
analyzing  the  learning  environment  and  experiences  of  eighth  grade  students  and  to 
assist  in  distinguishing  among  different  patterns  of  eighth  grade  schools  and  the 
effects  of  such  patterns  on  the  transition  of  students  to  the  tenth  grade  and  beyond. 

The  primary  purpose  of  the  Teacher  Survey  is  to  acquire  an  understanding  of  the 
effects  of  teaching  on  longitudinal  student  outcomes.  The  survey  will  link 
information  regarding  specific  teacher  characteristics  and  practices  to  information 
about  the  characteristics  and  outcome  measures  of  the  participating  eighth-grade 
students.  Thus,  data  re  collected  that  address  teacher  qualifications,  specific 
course  activities,  curriculum  exposure,  and  student-specific  characteristics  as  judged 
by  teachers.  The  overall  design  of  the  Teacher  Survey  reflects  the  four  curriculum 
areas  targeted  by  the  overall  goals  established  for  NELS:88.  These  areas  are: 
mathematics,  science,  English,  and  social  studies. 

Completion  Rates  of  the  School  Survey 

In  total,  51  school  questionnaires  were  administered,  and  46  completed 
questionnaires  were  returned,  resulting  in  a  90  percent  response  rate.  Of  the 
remaining  questionnaires,  three  principals  (6  percent)  refused  to  return  the 

sstionnaire,  and  two  principals  were  categorized  as  nonrespondents. 

Completion  Rates  of  the  Teacher  Survey 

A  total  of  302  teachers  in  the  51  participating  Field  Tesi  schools  were  requested 
to  respond  to  the  teacher  questionnaire.  Of  these,  284  returned  completed 
questionnaires  to  Westat.  Of  the  remainder,  seven  teachers  (2  percent)  refused  to 
return  the  questionnaire;  three  teachers  (1  percent)  were  categorized  as 
nonrespondents;  two  teachers  (1  percent)  were  no  longer  employed  by  the  school;  and 
six  teachers  (2  percent)  were  sampled  in  error.  Thus,  a  response  rate  of  96  percent 
(284/302-6)  was  achieved. 

Data  Collection  of  the  School  and  Teacher  Surveys 

In  preparation  for  the  two  surveys,  NORC  sent  the  foi^wing  to  Westat: 

-  School  File:  this  file  on  computer  tape  contained  all  information  about  the 
school,  including  ID  number,  name,  address,  Coordinator's  name,  and  survey  date 

-  Student  File:  this  file,  also  on  computer  tape,  contained  the  ID  numbers  and 
names  of  the  sampled  students 

-  Team  Leader  Information:  this  information  included  Team  Leader  names  and 
addresses,  and  school  assignments. 

NORC  sent  to  each  School  Coordinator  a  Class  Schedule  package.  This  included  a 
Class  Schedule  form,  a  cover  letter  explaining  the  study  and  the  importance  of  the 
form,  instructions  for  filling  out  the  form,  and  a  roster  of  sampled  students 
generated  by  NORC.  The  purpose  of  the  form,  which  was  to  be  filled  out  by  the 
Coordinator,  was  to  identify  the  teachers  and  classes  to  be  included  in  the  study. 
This  information  was  used  to  produce  the  teacher  labels  and  the  list  of  each 
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teacher's  sampled  classes.  Two  teachers  of  each  child  in  specified  subject  matters— 
mathematics,  science,  English,  or  social  studies — were  targeted. 

The  Class  Schedule  package  materials  worked  quite  well  although  some  School 
Coordinators  did  call  NORC  to  ask  for  clarification  of  instructions.  In  addition, 
We stat  needed  to  contact  several  Coordinators  to  resolve  questions  about  Class 
Schedule  information.  School  Coordinators  had  particular  difficulty  in  completing  a 
column  that  asked  for  a  "Class  Number,  a  unique  identifier  for  each  class  to  be  used 
for  processing  of  data.    Some  difficulty  was  also  encountored  by  School  Coordinators 
when  their  school  scheduled  classes  in  unusual  ways,  for  example,  having  a  class 
taught  at  different  times  on  different  days. 

Westat  prepared  unique  school  packets  containing  the  required  number  of  teacher 
and  school  questionnaires,  related  cover  letters,  and  instructional  materials  for  the 
return  of  the  school  packet  to  Westat.  Packets  were  delivered  to  the  school  in  one  of 
two  ways,  depending  on  how  close  to  Survey  Dav  Westat  received  the  completed  Class 
Schedule.  If  the  Class  Schedule  arrived  at  Westat  at  least  two  weeks  before  Survey 
Da",  Westat  mailed  the  packet  directly  to  the  school.  In  this  case  the  Team  Leader 
was  expected  to  pick  up  the  completed  questionnaires  on  Survey  Day.  If  the  Class 
Schedule  arrived  at  Westat  less  than  two  weeks  before  Survey  Day,  Westat  sent  the 
school  packet  to  the  Team  Leader,  who  delivered  it  to  the  School  Coordinator  on  Survey 
Day.  During  the  Field  Test  Wiistat  found  the  first  of  the  two  methods  superior, 
particularly  in  terms  of  the  amount  of  follow-up  that  needed  to  be  done  on  unreturned 
forms. 

One  substantial  problem  Westat  encountered  was  the  great  amount  of  time  it 
generally  took  a  School  Coordinator  to  return  the  school  packet.  Upon  investigation, 
it  was  often  discovered  that  the  School  Questionnaire  was  the  cause  of  the  delay. 
Apparently,  the  ave/age  length  of  time  required  by  the  principal  to  fiil  out  the 
questionnaire  was  considerably  longer  than  Westat  had  expected. 

As  noted  above,  the  completion  rate  fo.  the  School  Questionnaire  was  high. 
Moreover,  none  of  the  respondents  refused  to  answer  any  of  the  questions  and  the  Don't 
Know  response  was  seldom  used.  The  percentage  of  response  to  all  items  exceeded  90 
percent  following  all  follow-up  efforts.  Examination  of  answers  given  by  respondents 
revealed  minimal  difficulty  in  correctly  comprehending  questionnaire  items. 

As  with  the  School  Questionnaire,  substantial  item  nonresponse  follow-up  was 
required  on  the  Teacher  Questionnaire.  Item  nonresponse  follow-up  efforts  were 
required  for  225  questionnaires  (74.5  percent).  In  part,  this  high  percentage  of 
follow-up  was  due  to  the  amount  of  time  needed  to  complete  the  questionnaire.  Average 
time  requirements  reported  by  respondents  exceeded  Westat's  targeted  response  time.  A 
second  factor  that  explains  the  high  follow-up  rate  is  discrepancy  between  a  school's 
r  iport  that  a  student  was  assigned  to  a  particular  teacher's  class  and  the  teacher's 
report  that  the  student  was  not  so  assigned. 

Few  of  the  teacher  respondents  used  either  the  Don't  Know  or  Refusal  options. 
Examination  of  nonresponse  patterns  and  of  respondent  answers  on  individual  questions 
reveal  a  number  of  items  that  should  either  be  eliminated  or  revised  in  the  base-year 
version  of  the  Teacher  Questionnaire.  Nevertheless,  with  very  few  exceptions,  final 
response  rates  on  individual  questions  exceeded  90  percent. 
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Generally,  the  main  problem  encountered  in  conducting  the  School  and  Teacher 
Surveys  was  having  materials  flow  through  tne  system  in  a  timely  manner.  Westat  would 
very  much  like  to  be  able  to  mail  the  school  packets  to  the  schools  well  before  Survey 
Day,  so  that  the  Team  Leader  can  collect  the  completed  questionnaires  on  Survey  Day. 
Pre-survey  activities  of  the  base  year  will  be  designed  to  assure  that  this  is 
possible. 

A  critical  issue  direct!/  "elated  to  the  above  that  remains  to  be  resolved  is 
whether  or  not  to  retain  use  of  *he  Class  Schedule  in  the  base  year.  There  could  be 
considerable  advantage  to  having  teachers  (rather  than  school  principals  or  School 
Coordinators)  provide  information  that  identifies  which  teachers  instruct  which 
sampled  students  in  which  particular  periods.  For  example,  assuming  that  the  teachers 
provided  the  information  only  when  completing  the  Teacher  Questionnaire,  the 
information  gathered  would  be  the  most  current  possible.  If  all  teachers  in  the 
school  who  taught  the  two  selected  subject  matters  were  surveyed  (rather  than  a  sample 
of  teachers),  Westat  would  be  able  to  send  the  School  Packets  to  the  school  without 
regard  to  particular  selection  of  sample  students. 


RECOMMENDATIONS: 

(1)  Pro-survey  procedures  for  the  Teacher  and  School  Surveys  should  be  designed  to 

assure  that  Westat  is  able  to  mail  questionnaires  directly  to  the  schools  well  in 
advance  of  Survey  Day. 

(2)  All  teachers  of  eighth-graders  who  teach  any  of  the  two  tested  subject  matters 

should  be  surveyed  rather  than  a  subsample  of  such  teachers.  This  would 
eliminate  the  need  for  completion  of  a  Class  Schedule/Teacher  Matrix 


CHAPTER  SIX:  OTHER  FINDINGS 

Two  additional  issues  examined  in  the  field  test  were  the  possibility  of  gathering 
selected  student  data  from  student  records  rather  from  questionnaire  responses  and  the 
expected  magnitude  of  student  dispersion  at  the  time  of  the  first  follow-up  of 
NELS:88. 

Records  Availability 

On  the  recommendation  of  the  National  Advisory  Panel  for  NELS.88,  NORC 
investigated  whether  several  data  elements  could  be  more  efficiently  obtained  from 
students'  cumulative  records  than  from  alternative  resources  (such  as  parent  teacher 
or  student  questionnaires).  Efforts  were  made  to  collect  information  about  students' 
schedules,  their  age  and  race,  their  handicapped  status,  limited  English  proficiency 
status,  school  meal  program  participation  and  Title  I,  Chapter- 1  eligibility  and 
participation  from  students'  school  records.  An  additional  matter  studied  was  the 
relative  effectiveness  of  having  School  Coordinators  or  Team  Leaders  gather  the 
information  in  the  schools. 

NORC  Questioned  24  of  its  51  eighth-grade  School  Coordinators  concerning 
accessibility  to  student  records.  The  overall  finding  was  that  the  kinds  of  records 
which  NORC  is  considering  obtaining  in  the  base  year  are  generally  kept  by  .ne  schools 
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and  are  easily  accessible  by  school  staff  (specifically  the  Scho-'  Coordinator). 
However  it  was  also  discovered  that  usually  schools  would  r,o,  i„ake  their  files  and 
records  directly  available  to  NORC  Team  Leaders  without  prior  permission  having  been 
obtained.  Most  commonly,  explicit  parental  consent  or  district  state,  or  legal 
permission  was  required. 

Admittedly,  there  are  advantages  to  obtaining  information  from  school  records 
rather  than  from  questionnaires  completed  by  the  various  respondents.  Not  only  would 
respondent  burden  be  lessened,  but  also  school  records  might  be  more  accurate. 
However  there  are  also  serious  disadvantages  to  using  the  procedure.  Ramified 
permission  requirements  could  place  a  heavy  burden  on  School  Coordinators  and 
principals,  particularly  if  permission  had  to  be  obtained  explicitly  on  an  individual 
basis.  More  refusals  at  the  school  level  might  result  as  principals  perceived  an 
excessive  burden.  Furthermore,  there  is  no  guarantee  that  permission,  whichever  type 
is  required,  would  ultimately  be  granted.  For  the  individual  explicit  permission 
case,  a  certain  number  of  refusals  could  be  expected,  resulting  in  a  loss  of  data 
information.  Finally,  information  gathered  from  a  questionnaire  would  appear  in  a 
consistent  form,  while  information  from  xeroxed  records  would  not.  While  a  School 
Coordinator  could  enter  information  on  a  specially  designed  form,  this  would  be  very 
time  consuming  as  approximately  30  student  cases  would  be  involved.    Having  the  NORC 
Team  Leader  gather  materials  might  or  might  not  lessen  the  work  load  for  the  School 
Coordinator  since  the  Coordinator  would  typically  then  have  to  be  further  involved  in 
permission  acquisition.    More  stringent  permission  requirements  would  inevitably 
result  in  a  higher  degree  of  permission  denial. 

Student  Dispersion  and  the  First  FoMow-Up  Survey 

Anticipating  the  first  follow-up  of  NELS:88,  NORC  drew  upon  <ield-test  results  to 
provide  a  prediction  of  the  likely  scatter  patterns  of  NELS:88  students  in  1990. 
Reports  by  students  and  parents  as  to  which  high  schools  the  field-test  eighth-graders 
were  likely  to  attend,  together  with  school  principal  estimates  of  where  each  school's 
eighth-graders  would  attend  high  school,  were  used  to  estimate  dispersion  by 
individual  students  between  eighth  and  tenth  grades.  This  information  was  used  to 
determine  the  number  of  schools  that  would  need  to  be  approached  in  order  to  capture 
the  largest  percentage  of  students  possible  with  a  reasonable  expenditure  of  time  and 
money.  The  essential  question  being  addressed  was  the  following:  How  many  tenth 
grade  schools  should  one  expect  to  include  in  the  follow-up  effort  if  one  wants  to 
capture  at  least  85  to  90  percent  of  the  base  year  sample  two  years  after  the  base 
year? 

It  was  found  that  for  most  of  the  public  high  schools,  large  numbers  of  students 
will  transfer  as  a  fairly  intact  group  from  a  common  eighth  grade  school  to  a  common 
high  school.  An  exception  is  certain  large  urban  schools,  where  students  are 
presented  with  a  great*  r  array  of  high  schools  and  where  there  are  several  magnet 
programs.  A  great  o«*al  of  anticipated  student  dispersion  was  discovered  for  Other 
Private  schools.  An  intermediate  degree  of  dispersion  was  revealed  for  Catholic 
schools. 

The  analysis  centered  on  determination  of  the  optimal  student  cluster  size  to  be 
pursued  in  follow-up  efforts.  A  cluster  is  the  number  of  students  from  a  particular 
eighth  grade  school  movir.g  on  in  a  group  to  the  same  high  school. 
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The  results  of  the  Student  Survey  field  test  responses  concerning  anticipated  high 
school  attendance  indicate  that  as  one  decreases  the  minimum  cluster  size  to  be 
followed  up  on,  one  gains  increasing  percentages  of  students  up  to  a  certain  point. 
Then  the  curve  flattens  out  and  one  gets  smaller  additional  percentages  of  students 
for  each  decrease  in  minimum  cluster  size.  This  phenomenon  raises  the  issue  of 
whether  It  is  worth  the  tracking  effort  to  capture  those  few  students,  for  example, 
who  are  moving  on  to  high  school  in  clusters  of  only  one  or  even  two  individuals  The 
key  question  is  the  following:  How  much  does  one  add  to  the  sample  of  base  year 
students  followed  up  on  two  years  later  if  one  decides  to  follow  clusters  of  two 
students  rather  than  of  three  students?  This  i;  the  kind  of  issue  which  must  be 
resolved. 

Another  central  issue  that  needs  to  be  resolved  is  whether  the  same  minimum 
cluster  size  should  be  followed  up  on  for  all  sectors  of  schools  or  whether  the  sample 
of  private  school  students  should  be  protected  by  setting  a  smaller  minimum  cluster 
size  or  even  following  up  on  all  private  school  students.  It  is  important  to  maintain 
the  same  proportional  representation  of  Public.  Catholic,  and  Oth  ar  Private  school 
students  in  the  follow-up  study  that  existed  in  the  base  year. 

Essentially,  examination  of  the  field-test  results  indicates  that,  given  the 
suggested  dispersion  patterns  of  Public.  Catholic,  and  Other  Private  eighth-graders, 
setting  a  single  minimum  cluster  size  greater  than  two  would  not  permit  follow-up  of 
even  85  percent  of  the  base-year  students.  Using  the  two-person  minimum  cluster  size 
would  encompass  approximately  89  percent  of  the  field-test  public  school  students 
(with  72  schools  involved)  and  88  percent  of  the  field-test  Catholic  students  (with  20 
schools  involved),  but  only  71  percent  of  the  field-test  Other  Private  students  (with 
23  schools  involved).  Were  field-test  Other  Private  students  alternatively  pursued  in 
clusters  of  one.  95  percent  of  these  students  could  be  followed  up  (five  percent  could 
not  be  followed  up  for  lack  of  high-school  locating  information).  However,  60  schools 
would  be  involved.  This  illustrates  the  nature  of  the  decision  that  must  be  made. 

In  sum.  the  issues  that  must  be  resolved  are  the  following:  What  are  the 
implications  of  trying  to  follow  NELS:88  students  in  the  most  economical  units  as  they 
disperse  from  1988  to  1990?  What  kind  of  sampling  plan  is  appropriate  to  those  who 
fall  out  of  this  pattern?  Should  the  answer  to  the  latter  question  vary  according  to 
school  sector,  geographical  area,  or  some  other  criteria? 


CHAPTER  SEVEN:  SUMMARY  AND  CONCLUSIONS 

The  final  chapter  of  the  Field  Test  Report  draws  conclusions  and  summarizes 
principal  findings  concerning  the  adequacy  of  the  field  test  design.  The  discussion 
centers  on  four  features  of  that  design:  the  sample  plan;  pre-survey  activities;  the 
design  for  data  collection,  and  the  data  collection  instruments.  While  much  of  the 
subject  matter  covered  in  the  chaptei  has  been  incorporated  into  this  summary,  two 
issues  are  newly  raised  in  the  chapter.  The  first  is  the  possibility  that  district- 
level,  school-level,  and  even  individual-level  survey  data  might  be  provided  to 
NELS:88  participants.  The  second  is  the  advisability  of  employing  foreign-language 
contacting  materials  or  even  questionnaires  in  the  base  year. 
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~~  HSL8:88  PIBLD  TEST  REPORT:  INTRODUCTION 

This  report  examines  the  results  of  the  Pield  Test  of  survey 
questionnaires,  tests,  forms,  and  procedures  developed  for  use  in  the 
base  year  of  the  National  Education  Longitudinal  Study  of  1988 
(NBLS:88). 

HBLS:88  joins  the  national  Longitudinal  Study  of  the  High  School 
Class  of  1972  (MLS-72)  and  High  School  and  Beyond  (HS4B)  as  the  third 
in  a  series  of  longitudinal  studies  sponsored  by  the  Center  for 
Education  Statistics  of  the  U.S.  Department  of  Education.  These 
studies  are  designed  to  provide  trend  data  about  critical  transitions 
experienced  by  young  people  as  they  develop,  attend  school,  and  embark 
on  careers.    NELS:88  focuses  on  a  sample  of  students  who  will  be 
enrolled  in  the  eighth  grade  in  1988.    Pol low-up  surveys  at  two-year 
intervals  will  be  conducted  to  facilitate  long-term  trend  analyses. 

The  general  purposes  of  the  field  test  are,  in  anticipation  of  the 
base  year  effort,  to  test  instruments,  forms  and  procedures;  to 
experiment  with  different  approaches  to  data  collection;  and  to 
evaluate  the  overall  study  design. 

The  primary  research  instruments  are  a  series  of  cognitive  test 
batteries  in  four  subject  matter  areas  (English,  Mathematics,  Science 
and  Social  Studies),  and  questionnaires  covering  four  respondent 
populations— students,  parents,  teachers,  and  school  administrators. 
There  are  also  three  supplemental  sections  to  the  questionnaires:  the 
Language  Minority  Supplement,  funded  by  the  Office  of  Bilingual 
Education  and  Minority  Language  Affairs;  the  Mathematics  and  Science 
Supplement,  sponsored  by  the  National  Science  Poundation;  the  Gifted 
and  Talented  Supplement,  funded  by  the  Office  of  Planning,  Budget  and 
Evaluation  of  the  Department  of  Education. 

The  field  test  will  be  used  to  calibrate  items  so  that  reliable 
and  valid  base  year  versions  of  longitudinal  tests  can  be  developed. 
Item  parameters  were  estimated  for  the  eighth,  tenth,  «nd  twelfth 
grades.      Pretest  data  were  evaluated,  using  both  classical  and  Item 
Response  Theory  (IRT)  techniques  to  determine  which  items  are  mosl 
appropriate  for  inclusion  in  final  (base-year)  forms  fcr  each  test. 

An  item  non-.esponse  analysis  was  the  key  element  in  the  evaluation 
of  the  field  test  questionnaires.      High  nonresponse  items  were 
identified  and  the  nonresponse  interpreted  so  that  needed  revisions  in 
items  or  in  questionnaire  format  could  be  proposed.    All  skip  patterns 
were  checked  by  cross-tabulating  filter  and  dependent  questions. 

In  addition,  differences  in  item  performance  related  to  respondent 
characteristics  such  as  gender,  ethnicity,  or  SES  are  presented  and 
discussed  in  this  report.    Where  appropriate,  cross-validating 
comparisons  of  data  taken  from  more  than  one  respondent  source  (for 
example,  certain  items  asked  of  both  parents  and  students)  are  made. 
All  analyses  of  aggregate  response  have  been  supplemented  by  the 
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qualitative  evaluations  of  NORC  ruitors.  More  global  issues,  such  as 
questionnaire  length  and  respondent  burden,  have  also  been  addressed * 

Major  data  collection  procedures  to  be  evaluated  in  the  field  test 
included  sampling  and  sample  updating;  state,  district,  and  school 
contacting;  data  collection  for  all  four  respondent  populations;  and 
data  preparation.    The  various  documents  used  in  these  procedures  also 
were  to  be  tried  and  assessed.    Both  quantitative  analyses  (for 
example,  comparison  of  response  rate  and  etror  differences  associated 
with  different  procedures)  and  qualitative  analyses  (including 
debriefings  of  field  staff  and  school  coordinators)  will  influence  the 
evaluation  of  procedures  and  the  formulation  cf  recoranendations  for  the 
base  year. 

There  were  several  experiments  in  data  collection  methods.  The 
two  mc  t  important  of  these  were  an  investigation  of  the  effects  of 
holding  orientation  days,  and  an  experiment  involving  different  means 
of  distributing  the  parent  questionnaire. 

The  iield  test  report  is  divideo  into  seven  sections  or  chapters. 
The  first  chapter  concerns  field  test  preparation.    This  includes  the 
design  and  development  of  the  field  test  instruments,  respondent 
selection,  securing  cooperation  for  the  study,  obtaining  parental 
permission,  and  interviewer  recruiting  and  training. 

Chapter  Two  describes  field  test  data  collection  in  the  schools 
and  sketches  the  characteristics  of  the  student  sample,  student 
response  rates,  and  procedures  for  collecting  student  data. 

Chapter  Three  is  an  analysis  of  the  field  test  results  for  the 
student  survey.    The  chapter  discusses  student  sampling  data,  analyzes 
questionnaire  data,  proposes  item  am  format  revisions;  it  then 
addresses  the  student  cognitive  tests. 

Chapter  Pour  details  dana  collection  procedures  and  results  foj 
the  parent  survey.    It  contains  a  detailed  item  nonresponse  analysis 
for  the  parent  data  and  recommends  revisions  in  the  parent 
questionnaire. 

Chapter  Pi"e  presents  the  operational  procedures,  results,  and 
item  analyses  for  the  teacher  and  school  (administrator) 
questionnaires . 

Chapter  Six  addresses  other  findings,  specifically  the 
accessibility  of  student  records  and  the  implications  of  field  test 
results  for  plans  to  track  students  at  the  time  of  the  NELS:88  first 
follow-up. 

Chapter  Seven  contains  a  summary  and  conclusion,  including  an 
evaluation  of  the  overall  study  design.  It  is  followed  by  appendices 
that  exhibit  the  various  field  tesr  instruments  and  forms. 
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CHAPTRE  1:      FIELD  TEST  PREPARATION 


1.1    Development  of  Field  Test  Instruments  and  Forms 

Development  of  field  test  instruments  and  form*  b^gan  with  the  contract 
award  on  February  4,  1986.    After  the  initial  project  meeting  between  CES 
»t*ff        key  project  staff  of  NORC  and  its  subcontractors,  efforts  were 
initiated  to  identify  suitable  nominees  for  a  National  Advisory  Panel  (NAP) 
to  give  guidance  on  instrument  development,  design,  and  data  collection 
issues.    At  the  same  time,  work  began  on  content  outlines  for  all 
questionnaires  and  tests. 

Questionnaire  and  test  content  outlines  were  submitted  to  CES  March  21, 
1986,  and  were  discussed  at  the  first  National  Advisory  Panel  meetings,  held 
in  Washington,  D.C.,  April  1-2,  1986. 

The  student  questionnaire  outline  stressed  the  priorities  of  NELS:88, 
particularly  in  collecting  policy-relevant  data  on  educational  processes  and 
outcomes.    The  first  and  overriding  priority  was  described  as  the  collection 
of  student  longitudinal  data.    Since  the  primary  research  objectives  of 
NBLS:88  are  longitudinal,  survey  item*  were  to  be  selected  for  their 
usefulness  in  predicting  or  explaining  future  outcomes  as  measured  in  later 
survey  waves.    The  longitudinal  purposes  of  the  survey,  it  was  emphasized, 
largely  preclude  items  that  seek  derailed  retrospective  information  to 
explain  students1  current  status.    The  second  priority  was  described  as  tbu 
procurement  of  valuable  cross-sectional  data,  wherever  that  objective  proved 
consistent  with  the  longitudinal  focus  of  the  study. 

The  outline  posited  r    ee  major  content  domains  for  the  student 
questionnaire:    students1  background  and  environmental  factor);  the 
individual  students1  experiences,  beliefs,  values  and  aspirations;  and 
students1  school  experiences.    An  additional  category  of  questionnaire  items 
would  seek  locating  information  needed  for  successful  follow-up  of 
respondents  in  1990.    Special  emphasis  was  given  to  the  need  for  the 
development  of  a  questionnaire  that  would  not  exceed  forty  to  forty-five 
minutes  in  the  field  test;  the  need  to  determine,  for  each  potential  datum 
that  it  would  be  desirable  to  collect,  whether  the  student  represents  a 
better  source  of  information  than  the  teacher,  principal,  or  parent;  and, 
finally,  the  need  to  tailor  items  to  an  eighth  giaders1  level  of 
ttderstauding.    Two  other  factors  informed  discussion  of  the  content 
outline.    One  was  the  desirability  of  identifying  and  adapting  the  most 
successful—  an«t  suitable,  given  the  characteristics  of  this  age  group — 
baseline  measures  from  the  earlier  Department  of  Education  longitudinal 
studies,  in  order  to  facilitate  cross-cohort  comparisons.    The  other  was  the 
need  to  integrate  questionnaire  development  activities  for  VELS:88  with 
other  CES  studies,  such  that,  for  example,  items  from  the  National 
Assessment  of  Education  Progress  (NAEP)  cou.  -  be  regarde *  as  part  of  the 
item  pool  for  NELS:88  quite  as  much  as  quest    ns  used  .«  High  School  and 
Beyond  (HS&B)  and  the  National  Longitudinal  Study  of  the  High  School  Class 
of  1972  (NLS-72).    In  the  context  of  these  considerations,  the  advisory 
panel  considered  'he  overall  study  design  and  the  content  outlines  for  the 
tests  and  quest,  .naires. 
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On  the  basis  of  the  recommendations  of  the  panel  and  further  conments 
by  Longitudinal  Studies  Branch  staff    questionnaire  outlines  were  revised 
and  resubmitted  to  CBS  on  Hay  6,  1986.    A  cover  memo  was  prepared  to  provide 
guidelines  to  reviewers  on  the  National  Advisory  Panel,  in  the  various 
Department  of  Education  policy  offices  (for  example,  the  Office  of 
Vocational  and  Adult  Education,  Office  of  Private  Education,  Office  of 
Special  Education,  Office  of  Planning  and  Evaluation),  and  in  external 
agencies  concerned  with  educational  policy  and  research.    Reviewers  were 
provided  with  a  concise  statement  of  the  major  research  objectives  of  the 
study,  and  were  asked  to  evaluate  all  proposed  topic  areas  and  to  recommend 
priorities  among  them  for  use  by  CES,  the  NAP  and  NORC  in  reducing  the 
questionnaires  to  manageable  length.    Written  consents  were  requested  to  be 
returned  to  NORC  by  Nay  30  in  order  to  be  discussed  at  the  second  NAP 
meeting  scheduled  for  June  10-11,  1986.    In  addition,  discussions  were  held 
with  Department  of  Education  and  National  Science  Foundation  officials 
concerning  the  Gifted  and  Talented  and  the  Mathematics  and  Science 
questionnaire  supplements,  and  with  the  Office  of  Bilingual  Education  and 
Minority  Language  Affairs  concerning  the  minority  language  instrument  and 
student  supplement.    Two  language  minority  conferences,  attended  by  invited 
specialists  in  Hispanic  and  Asian-Pacific  American  educational  policy 
Issuer*,  were  held  to  help  develop  the  minority  language  supplements. 
Meanwhil actual  items  representing  the  topic  areas  of  the  content  outlines 
were  drticed. 


The  second  National  Advisory  Panel  meeting  was  held  on  June  10-11, 
1986,  in  Washington,  D.C.     Most  of  the  meeting  time  was  devoted  to 
reviewing  the  revised  content  outlines  for  the  field  test  questionnaires. 
The  major  objective  of  the  review  was  to  ensure  that  draft  field  test 
questionnaires  would  cover  topics  deemed  of  highest  priority  for 
longitudinal  policy  research  within  the  budgeted  limits  for  questionnaire 
length  and  respondent  burden.    Panel  members,  CES  staff,  and  contractor 
staff  discussed  each  element  in  the  content  outlines  in  exhaustive  detail. 
Based  on  these  discussions,  CES  staff  provided  NORC  and  its  subcontractors 
with  specific  guidelines  for  prioritizing  topic  areas  in  all  questionnaires. 

Draft  questionnaires  were  submitted  to  CES  between  June  27  and  July  2, 
1986.  A  CES  Interdi visional  Review  Committee  met  with  Longitudinal  Studies 
Branch  staff  during  the  week  of  July  7  -  11,  and  made  additional 
recommendations  tor  revisions.  These  recommendations  were  received  by  NORC 
on  July  11.  Over  the  following  ten  days,  instrument  development  activities 
centered  on  the  incorporation  of  these  many  helpful  suggestions  into  the 
draft  questionnaires.  Revised  questionnaires  were  submitted  to  CES  on  July 
21,  1986. 

Work  also  began  in  July  on  the  FEDAC~v*tB  Clearance  Package.  This 
document  contained  a  supporting  statement  for  the  study  and  incorporated 
justifications  for  the  content  areas  to  be  addressed.    It  also  presented 
final  versions  of  the  survey  items.    A  first  draft  of  the  Clearance  Package 
for  NELS:88  Field  Test  instalments  and  forms  was  submitted  to  CES  on  August 
12,  1986.    After  incorporation  of  ?EDAC  recommendations ,  the  document  was 
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submitted  to  OMB  on  September  18,  1986.    0MB  recommendations  were 
incorporated  into  the  field  test  instruments  end  final  clearance  was 
received  on  December  8,  1986.    The  questionnaires  were  then  formatted  for 
printing. 

1.2     Sample  Design  and  Selection 
1.2.1  Overview 

The  field  test  school  sample  was  drawn  in  several  stages.    First,  five 
states  were  selected  on  the  basis  of  their  importance  to  the  success  of  the 
bass-year  study,  their  demographic  heterogeneity,  and  their  representation 
of  a  particular  region  of  the  united  States.    Two  counties  were  selected 
within  each  state.    Some  52  schools  were  then  selected  with  probability 
proportional  to  eighth  grade  enrollment  within  a  regular  stratum  (public 
schools)  end  a  special  (oversampled)  private  stratuu.    All  eighth  grade 
students  within  selectee*  schools  were  then  assigned  to  one  of  three  sample 
statue-:    core,  Asian-Pacific,  or  Hispanic.    Within  each  school,  thirty- 
two  eignth  grade  students  were  selected.    Eligible  students  were  randomly 
chosen,  within  each  of  the  three  statuses,  using  a  separate  sampling 
fraction  for  each  so  that  Asian-Pacific  and  Hispani-  ethnicities  could  be 
oversampled  within  each  school. 

High  schools  were  chosen  with  consideration  to  their  proximity  to 
selected  eighth  grade  schools.    Sixty  tenth  and  sixty  twelfth  grade  students 
were  randomly  sampled  :rom  the  eligible  students  in  the  selected  high 
schools.    Only  a  core  wample  was  drawn  in  the  high  schools—that  is,  there 
wis  no  oversampling  of  Hispanics  or  Asians-Pasif ic  Islanders. 

1.1       Count/  Selection 

j  counties  per  state  wer*  seiecte-i  from  each  of  the  5  field  test 
St.  The  selection  of  two  counties  delimited  the  geographical  area  from 

wtnch  fxhools  were  chosen,  thereby  minimising  travel  costs  for  the  two  or 
tbree  survey  teams  assigned  to  that  geographical  area.    Since  population 
estimates  are  not  desired  for  the  field  test,  this  cost-sensitive  strategy 
wan  appropriate. 

To  ensure  experience  in  all  types  of  schools,  two  rural  counties  were 
selected— one  from  Illinois  and  the  other  from  Texas. 

While  this  was  not  a  representative  sample,  all  counties  were  selected 
using  a  probability  function  to  guard  against  selection  bias.    In  fact,  all 
counties  were  selected  with  probability  proportional  to  eighth  grade 
enrollment  according  to  the  following  procedures: 

I.       SPSS  system  files  were  constructed  fvom  the  Quality  Education  Data 
(QED)  tape.  QED  is  a  private  firm  that  maintains  an  education 
database  of  schools.    One  SPSS  system  file  was  constructed  for 
each  of  the  five  field  test  states. 
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The  URBAN  variable  from  the  QED  file        recoded  to  reflect  three 
possible  values  at  the  school  level:    urban,  rural,  or 
unclassified.    Essentially,  the  urban  and  suburban  values  were 
collapsed  into  one  value  that  would  now  identify  suburban  schools 
as  urban  schools. 


Next  counties  were  categorized  into  rural  or  urban.    In  the  case 
where  a  county  was  composed  of  both  urban  and  rural  schools,  a 
category  was  chosen  based  on  the  status  (i.e.,  urban  or  rural)  of 
the  majority  of  the  schools  within  that  particular  county. 

The  files  for  eac'  of  the  field  test  states  were  sorted  by  the 
URBAN  variable  and  seven  separate  counties  were  selected.  These 
seven  counties  are  listed  below  by  the  urban/rural  designation. 

2  urban  counties  in  NY 

2  urban  counties  in  PL 

2  urban  counties  in  CA 

1  urban  county  in  IL 

1  rural  county  in  IL 

1  urban  county  in  TX 

1  rural  county  in  TX 

These  counties  were  selected  with  probability  proportional 
to  eighth  grade  enrollment  according  to  the  following 
specifications: 

N     ■  #  cases  in  the  file 
n     *  #  cases  to  be  sampled 
cw£  *  cumulative  size  of  case  i 

The  county's  PIPSCC  (Federal  Information  Processing  Standards 
County  Code)  and  aggregate  grade  8  size  were  listed.    Then  the 
cumulative  size  for  case  i  was  calculated. 


CW£  = 


such  that, 


wl 

wl  ♦  w2 
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The  sampling  interval  (Si)  was  calculated  by  the  algorithm 


SI*cwn/n 

A  random  start  (RS)  was  chosen  such  that  0<  RS  <=  SI.  Random 
numbers  were  generated  for  each  state's  system  file  using  the 
command  COMPUTE  QVAR-UNIPORM(SI)  in  SPSS/PO.    The  first  random 
number  generated  was  selected  for  use. 

Then  cases  were  selected  such  that: 

RS  ♦  0*SI  «  cumulative  sum  to  choose  for  #1 

RS  ♦  1*SI  =  cumulative  sum  to  choose  for  #2  ...  etc, 

1.2.3     Sample  Size:    Number  of  Schools  and  Students  To  Be  Chosen 

In  reviewing  the  school  data  it  was  noted  that  the  number  of  schools 
that  contained  tenth  and  twelfth  grades  as  well  as  an  eighth  grade  was  very 
small.    Therefore,  a  field  administration  strategy  that  focused  on  these 
types  of  schools  to  limit  costs  was  not  plausible.    However,  it  was  decided 
to  sample  eighth  grade  schools  and  then  select  high  schools  that  were  in 
close  proximity  to  the  eighth  grade  schools  chosen. 

The  target  student  sample  size  was  determined  by  the  needs  of  test 
development.    Given  the  large  test  item  pool,  two  forms  of  the  tests  (Form  A 
and  Form  B)  were  to  be  administered  at  each  grade  level,  with  each  test  item 
appearing  on  one  of  the  two  forms.    In  order  to  analyze  varU  ice  in  test 
scores  and  item  response  rates  across  grades,  a  total  of  befwaen  1,200  and 
1,500  test  observations  (600-750  per  form)  was  desirable,  and  a  minimum  of 
1,000  essential. 

Pifty-two  eighth  grade  schools  were  selected  for  the  sample  and  32 
students  within  each  school  were  randomly  selected  to  participate  in  the 
survey.    Sample  size  was  held  to  32  students  so  that  the  field  test  sampling 
and  survey  administration  for  eighth  graders  would  approximate  base-year 
conditions 

Thirty  high  schools  were  selected  for  participation  in  the  study  and  60 
students  were  randomly  selected  within  both  the  tenth  and  twelfth  grades. 
Since  the  high  school  sampling  did  not  need  to  approximate  eighth  grade  base 
year  conditions,  this  larger,  more  cost-efficient  sample  of  up  to  120 
students  per  school  was  drawn. 

This  design  specified  that  more  high  school  students  would  initially  be 
drawn  than  eighth  graders,  in  order  to  compensate  for  sample  attrition. 
Last-minute  sample  updating  permits  a  chance  for  selection  of  students  who 
transferred  in  after  the  initial  roster  has  been  drawn.    In  principle, 
selected  transfer-ins  should  roughly  compensate  for  the  number  of  transfer- 
outs  in  the  same  period.    Sample  updating  procedures  would  be  instituted  for 
eighth  graders,  as  a  trial  of  base  year  methods.    Sample  updates  would  not, 
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however,  be  instituted  in  high  schools,  where  the  procedure,  owing  to  the 
larger  numbers  of  tenth  and  twelfth  graders  per  school,  would  prove 
burdensome  to  school  coordinators,  and  would  carry  with  it  few  lessons 
generalisable  to  eighth  graders  in  1988. 

1.2.4    School  Selection 

Pirst,  eighth  grade  schools  in  each  county  chosen  were  sorted  by 
district.    In  the  next  step,  schools  were  categorized  according  to  file  type 
Ipublic,  other  private,  or  Catholic  sector)  within  district.  This 
categorization  allowed  for  the  total  number  of  schools  (W)  and  the  total 
number  of  eighth  grade  students  for  each  file  type  (cumulative  sum)  to  be 
calculated  for  each  district. 

School  listings  for  each  county  were  divided  into  3  separate  files,  one 
for  each  file  type.    Fifty-two  separate  strata  were  generated. 

The  schools  were  selected  with  probability  proportional  to  eighth  grade 
size  according  to  the  following  specifications. 

N  =  #  of  cases  in  the  sample 
n  =  #  of  cases  to  be  sampled 
cw{  =  cumulative  size  of  case  i 

The  cumulative  grade  8  size  for  each  school  was  calculated  using  Lotus. 

The  sampling  interval  (Si)  was  calculated  according  to  the  following 
algorithm.  * 

SI  =  cvfl/n 

A  random  start  (RS)  was  chosen  such  that,  0<  RS  <=  SI.    Random  numbers  were 
generated  for  each  stated  system  file  using  the  command  COMPUTE 
STARTNO=UNIFORM(SI)  in  SPSS/PC*.    The  first  random  number  generated  was 
selected  for  use. 

The  schools  were  selected  such  that, 

RS  ♦  0*SI  =  SELECTION  1 
RS  ♦  1*SI  =  SELECTION  2 

I 

I 

I 

RS  ♦  n*SI  =  SELECTION  n  ♦  1 

If  a  particular  school  had  fin  enrollment  >    SI,  that  school  was 
automatical' y  chosen  for  the  sample,  but  if  additional  schools  needed  to  be 
selected,  that  school  was  removed  from  the  sample  and  the  aforementioned 
procedure  was  repeated. 
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1.2.5    Student  Selection 


As  soon  is  school  cooperation  was  secured,  the  next  step  was  to  obtain 
complete  rosters  of  ell  students  classified  as  eighth  graders  during  the 
fall  term  of  the  1986-87  school  year.    The  school  principal  or  his/her 
designated  representative  was  asked  to  review  the  roster  to  identify 
students  whose  physical,  emotional,  or  learning  handicaps  or  linguistic 
disabilities  would  effectively  preclude  participation  in  the  survey.  The 
school  administrator  was  asked  to  code  the  specific  reason  for  ineligibility 
in  each  indiv  , dual  case.    For  the  coordinators  instructions  for  coding  and 
annotating  the  eighth  grade  roster,  see  the  List  of  Appendices. 

The  administrator  was  also  asked  to  annotate  the  eighth  grade  roster  so 
that  all  Hispanic  and  Asian-Pacific  students  could  be  separately  identified. 
Three  lists  of  eligible  students  were  then  produced,  separating  students 
into  core,  Hispanic,  and  Asian-Pacific  Islander.  No  student  appeared  on  more 
than  one  list— that  is,  if  a  student  was  classified  as  Hispanic  or  Asian- 
Pacific  in  ethnicity,  that  student  was  removed  from  the  core  list.  This 
field  test  procedure  will  not  be  repeated  in  the  base  year,  which  will 
require  the  merging  of  core  and  supplementary  samples  for  population  and 
subgroup  estimate*.    Then,  the  core  sample  will  be  drawn  from  the  list  of 
all  eligible  students  without  regard  to  ethnicity,  and  supplementary  Asian 
and  Hispanic  samples  will  be  drawn  from  the  lists  of  all  remaining  Asian  and 
Hispanic  students. 

Random  numbers  were  generated  using  a  computer  program  (developed  by 
NORC's  sampling  statisticians)  that  takes  account  of  class  size,  desired 
sample  size,  and  numbers  of  OB EM LA  supplementary  students  identified  on  the 
school  roster.    The  field  test  procedure  was  to  select  the  same  proportion 
of  Hispanics  as  were  present  in  the  eighth  grade  of  the  school,  while  Asians 
were  selected  at  a  rate  double  their  representation  in  the  schools  eighth 
grade.    Once  the  supplementary  samples  were  drawn,  the  balance  of  students 
needed  to  reach  the  desired  sample  size  of  32  was  selected  from  the  list  of 
core  students. 

The  method  for  capturing  OBEMLA  supplementary  students  will  be  adjusted 
in  the  base  year  so  that  desired  supplementary  sample  sizes  (each  supplement 
will  encompass  approximately  1,600  students)  can  be  achieved.    The  field 
test  had  no  such  specific  numerical  target  for  Hispanic  and  Asian-Pacific 
students,  but  rather  the  more  general  goal  c~  capturing  large  enough  numbers 
of  language  minority  students  to  sustain  a  reasonable  trial  of  the  language 
minority  items  in  the  student  questionnaire,  and  to  assess  any  possible 
impact  of  subgroup  membership  on  other  items  in  the  research  instruments.  A 
second  goal  was  to  assess  the  basic  supplementary  sampling  procedures, 
particularly  the  school's  capacity  to  accurately  identify  such  students  on 
eighth-grade  rosters.    Success  in  reaching  these  two  goals  will  be  evaluated 
in  Chapter  Three  of  this  report. 

Supplementary  samples  were  not  drawn  for  the  high  schools.    Using  the 
same  computerized  sampling  program  that  was  employed  with  eighth-grade 
schools,  random  samples  of  sixty  tenth  graoers  and  sixty  twelfth  graders 
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were  drawn  from  the  eligible  students  (the  sane  definition  of  eligibility 
was  used  for  the  high  schools  as  was  used  for  eighth  grade)  in  the 
appropriate  grade  level  of  the  school. 

The  N ELS: 88  field  test  also  experimented  with  procedures  for  handling 
transfer  students  (in  and  out  of  the  selected  schools).  To  adjust  the 
student  sampling  frame  to  reflect  changes  in  the  sample,  the  roster  was 
updated  one  week  fo  ten  days  prior  to  the  actual  data  collection.      At  this 
time,  additional  sample  changes,  including  such  changes  of  status  as 
death  or  having  dropped  out  since  selection,  were  also  notid,  with  the 
roster  again  annotated  to  record  these  students  as  having  been  lost  to 
the  sample  for  specified  reasons. 

Transfers-out— that  is,  any  student  who  had  left  the  school  and 
who  was  enrolled  in  a  new  school— were  noted,  and  stricken  from  the 
sample.    Transfers-in — that  is,  any  student  who  transferred  into  the 
eighth  grade  of  the  school  subsequent  to  the  date  on  which  the  sampling 
roster  was  generated  —were  also  listed.    Names  of  transfer  students 
were  listed  by  ethnicity— core,  Hispanic,  Asian-Pacific  Islander— as  in 
the  initial  selection.    Each  new  student  was  given  a  chance  of 
selection  into  the  sample.    Transfers-in  were  selected  with  the  same 
probabilities  as  students  who  were  included  in  the  initial  sampling  in 
that  particular  school,  so  that  the  within-school  weights  of  initially 
selected  students  and  selected  transfer  students  would  be  the  same. 
This  was  accomplished  by  utilizing,  for  each  of  the  three  selection 
lists,  the  same  number  sequence  for  selection  that  had  obtained  in  the 
Initial  sampling  of  the  school.    If  the  first  random  number  was  greater 
than  the  number  of  new  students,  no  new  student  was  sampled.    If  a 
school  had  many  students  transferring  in  but  few  transferring  out,  it 
was  possible  to  have  a  sample  sire  slightly  greater  than  the  original 
selection  of  32  eighth  graders.    We  did  not  attempt  to  compensate  for 
the  other  forms  of  sample  attrition.    (Also,  no  attempt  was  made  to 
update  the  high  school  sample,  in  any  way.)    While  in  High  School  and 
Beyond,  students  who  had  died,  become  unavailable  or  incapacitated,  or 
had  dropped  out  were  substituted  for,  students  who  were  lost  to  the 
sample  for  such  reasons  in  the  NELS:o8  field  test  were  not  replaced. 
The  sample  updating  procedures  will  be  assessed  in  Chapter  Three  of 
this  report. 

1.3.0         Securing  Cooperation 
Introduction 

Securing  approval  to  condurt  the  study  from  school  authorities  at 
various  levels  was  a  major  task  w.  the  field  test.    This  process  was 
shaped  by  the  fact  that  each  individual  school  belongs  to  one  of  three 
school  sectors,  each  of  which  has  its  own  organizational  structure: 
the  public  schools;  the  Catholic  school  system;  and  non-Catholic 
private  schools.  Each  system  exhibits  different  kinds  of  authority 
relations  between  local  and  non-local  school  structures,  which  in  turn 
make  for  differences  in  the  approval  process. 
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Public  schools  exist  within  a  hierarchy  of  authority  that  extends 
frost  the  state  education  department  under  a  Chief  State  School  Officer; 
to  a  district  headed  by  a  superintendent  and,  normally,  governed  by  a 
school  board;  to,  sometimes,  a  more  local  and  subordinate  district  or 
subdistrict;  and  finally  to  the  individual  public  school  headed  by  a 
school  principal.      While  for  the  public  schools  there  is  no  higher 
point  of  authority  than  the  state  education  department,  the  state 
chiefs  associate  at  the  national  level  in  the  Council  of  Chief  State 
School  Officers.    Each  of  these  authority  levels— state,  district,  and 
school—exhibits  a  degree  of  autonomy,  such  that  securing  cooperation 
at  a  higher  level  does  not  carry  with  it  a  guarantee  that  subordinate 
levels  within  the  authority  structure  will  also  agree  to  participate  in 
a  study  such  as  NELS:88. 

Catholic  schools  exist  within  a  more  limited  hierarchy  of 
authority  consisting  of  only  the  diocese  or  archdiocese  and  the 
individual  school.    There  is  no  state-wide  or  national  authority, 
though  the  National  Catholic  Education  Association  gives  voice  to  the 
common  interests  and  concerns  of  Catholic-sector  schools. 

Non-Catholic  private  schools  seldom  acknowledge  any  authority 
other  than  the  local  school.    In  a  very  few  cases,  some  limited,  local 
hierarchy  of  authority  may  obtain.    While  no  one  organization  speaks 
for  this  sector,  there  are  influential  national  and  regional  groups 
that  articulate  the  views  and  objectives  of  various  segments  in  the 
non-Catholic  private  school  sector. 

In  approaching  the  public  sector  schools,  we  first  sought  approval 
from  the  Council  of  Chief  State  School  Officers.    Then  we  contacted 
Chief  State  School  Officers.    When  their  approval  had  been  secured,  we 
contacted  district  superintendents.    Finally,       contacted  the  school 
principals. 

In  approaching  the  Catholic  schoolss  we  informed  the  National 
Catholic  Education  Association  and  relevant  archdioceses  and  dioceses 
of  the  field  test,  then  contacted  the  principals  of  sampled  schools. 
In  the  case  of  other  private  schools,  we  contacted  the  school  principal 
directly. 

1.3.1  Role  of  CEIS  and  Other  Bodies 

Prior  to  contacting  the  chief  state  education  officers  of  the  five 
field  test  states,  endorsement  of  the  study  was  sought  from  the 
Committee  on  Evaluation  and  Information  Systems  (CEIS)  of  the  Council 
of  Chief  State  School  Officers.    Dr.  John  Stiglmeier,  a  member  of  the 
National  Advisory  Panel  for  NELS:88  who  is  also  active  in  CEIS, 
reviewed  the  NELS  V  design  and  survey  materials  on  behalf  of  CEIS, 
recommended  approval,  and  upon  approval  was  appointed  the  official 
CEIS-NELS:88  liaison.    CEIS  also  delegated  to  its  Subcommittee  on 
Testing  the  task  of  monitoring  the  development  of  the  NELS:88  cognitive 
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test  battery.    The  feet  of  CEIS  approval  of  the  field  test  was 
incorporated  into  the  state  contact  letter. 

Letter  and  telephone  contact  was  initiated  with  the  National 
Catholic  Education  Association  (NCSA).    This  contact  took  place  at  a 
tim*  of  transition  at  NCSA,  with  a  new  president  just  stepping  into 
that  role.    While  the  new  president  had  little  time  to  consider  ways  of 
assisting  with  the  field  test  during  the  transition  period,  she 
suggested  that  contact  be  re-established  in  the  spring  of  1987  so  that 
NCSA  could  explore  ways  that  the  base-year  study  could  be  supported— 
particularly,  Beans  by  which  NCEA  might  be  of  help  in  securing  the 
cooperation  of  Catholic  schools.    Contacts  with  NCEA  will  be  followed 
up  in  anticipation  of  the  base  year,  and  contacts  with  organizations 
representing  other  private  schools  (for  example,  the  Council  on 
American  Private  Education  [CAPE]  and  the  National  Association  of 
Independent  Schools  [MAIS]  will  be  initiated. 

1*3.2  Securing  State  Cooperation 

The  first  step  toward  securing  cooperation  with  the  public  school 
sector  was  taken  at  the  state  level.    In  August  of  1986,  the  NORC 
Project  Director  gent  a  letter  to  Chief  State  School  Officers  in 
Florida,  Hew  York,  California,  Texas  and  Illinois,  requesting  each 
state  s  cooperation  in  the  field  test  of  NELS.88.    Specifically,  the 
letter  and  accompanying  informational  materials  explained  the  study's 
design  and  purposes,  and  noted  that  the  NELS:88  materials  and  design 
had  been  reviewed  on  behalf  of  CEIS  by  Dr.  John  Stiglmeier,  who  had 
given  tentative  approval  of  the  survey  and  would  recommend  its 
endorsement  by  CEIS  at  its  September  1986  meeting.    In  addition,  the 
letter  requested  that  the  Chief  State  School  Officer  appoint  a  State 
Coordinator  for  NELS:88.    The  role  of  the  State  Coordinator  was  defined 
in  relation  to  three  tasks:    (1)  to  maintain  liaison  between  the 
oroiect  and  the  state  department  of  education  so  that  project  staff 
could  keep  the  state  informed  of  the  p  ogress  of  the  field  t?st;  (2>  to 
handle  ?nq,  *.ries  from  district  supervisors  concerning  ?tate  approval  of 
the  study;  (3)  to  consult  with  project  staff  on  those  survey-related 
problems  at  the  district  or  local  school  level  that  might  require 
resolution  frOk>  the  state  department  of  education. 

Ten  days  after  the  mailing,  the  Project  Director  and  Associate 
Project  Director  telephoned  the  five  Chief  State  School  Officers  to 
confirm  receipt  of  the  materials  and  to  urge  endorsement  of  the  stuJy. 
In  most  cases,  by  this  time,  the  chief  had  delegated  responsibilities 
.for  further  contacts  with  NORC,  if  he  had  not  already  appointed  a 
coordinator.    Chief  State  School  Officers  or  their  designated 
representatives  required  relatively  little  in  the  way  of  persuasion, 
although  they  often  required  additional  information  and  were 
particularly  interested  to  lecrn  which  districts  in  their  states  would 
be  asked  to  participate.    After  securing  the  state's  endorsement,  the 
next  matter  of  business  was  to  obtain  the  name  of  a  State  Coordinator. 
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1.3.3 


Role  of  State  Coordinators 


The  State  Coordinator  was  typically  a  staff  member  of  the  state 
education  department,  usually  someone  concerned  with  research  and 
evaluation.     After  NORC  received  the  name  of  the  appointed  state 
official,  the  Associate  Project  Director  called  to  welcome  him  or  her 
to  the  National  Education  Longitudinal  Study  of  1988,  discussed  the 
role  of  the  State  Coordinator,  and  sent  additional  materials  about  the 
study  as  veil  as  a  list  of  districts  to  be  contacted  and  a  copy  of  the 
proposed  contact  letter  for  district  superintendents.    In  four  states, 
coordinators  requested  no  changes  in  the  draft  NORC  district  contact 
letter,  although  all  reviewed  it  and  insisted  on  their  right  to  ask  for 
modifications  if  they  thought  them  necessary.    In  New  York,  in  order  to 
tailor  the  NORC  letter  to  the  State  Department  of  Education  letter, 
minor  changes  were  effected  in  the  NORC  district  contact  letter. 

At  this  time,  ways  of  contacting  the  districts  were  explored  with 
the  State  Coordinator.    Three  main  options  were  mentioned.    The  first 
possibility  was  that  the  district  contact  letter  could  be  modified  so 
that  it  became  a  joint  letter,  from  the  NORC  Project  Director  and  the 
State  Coordinator.    The  second  option  was  that  NORC  would  proceed  and 
send  the  contact  letter  under  the  Project  Director's  signature.  The 
third  possibility  was  that  a  separate  state  letter  precede  or  accompany 
the  NORC  district  contact  letter. 

Given  the  need  to  contact  the  districts  as  quickly  as  possible,  it 
was  usually  mitually  agreed  that  NORC  should  send  its  prepared  contact 
letter  at  once,  and  that  the  coordinator  would  not  write  to  or 
otherwise  contact  a  district  unless  there  was  need  for  specific 
intervention.    The  one  exception  to  this  was  New  York  State,  where  Dr. 
Stiglmeier  sent  his  own  letter,  and  asked  that  NORC  refrain  from 
sending  its  district  letter  until  after  superintendents  had  time  to 
read  the  letter  from  the  state.    Some  other  coordinators  would  have 
been  willing  to  write  letters  or  contribute  to  the  NORC  letter,  but 
would  have  required  considerable  lead  time  in  order  to  do  so.  Others 
were  not  convinced  that  this  would  be  in  any  way  useful  in  their 
states.    Since  the  project  Master  Schedule  calls  for  somewhat  earlier 
(May  27-August  29,  1986)  state  contacts  in  the  base  year,  it  also 
offered  more  opportunity  to  work  with  willing  state  coordinators  to 
develop  joint  letters  to  superintendents  of  selected  districts. 

Coordinators  wished  to  be  kept  informed  about  the  progress  of  the 
study  in  their  state.    None,  however,  requested  a  formal  report.  All 
expressed  their  willingness  to  be  consulted  for  advice  and  for  special 
help,  though  several  stressed  that  they  had  limited  influence  in  the 
matter  of  persuading  superintendents  to  participate  in  such  a  study. 
All  of  the  state  coordinators  were  busy  people,  with  demanding 
schedules,  often  involving  extensive  travel.    Their  availability 
therefore  was  often  limited,  and  one  recommendation  we  would  make  for 
the  base  year  is  that  whenever  possible  State  Coordinators  appoint  a 
deputy  capable  of  covering  their  duties  in  their  absence.    Within  the 
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limits  of  their  physical  availability,  however,  all  of  the  State 
Coordinators  proved  consistently  willing  to  help. 

After  district  contact  had  been  initiated,  State  Coordinators 
assisted  the  study  in  several  ways.  Scate  Coordinators  were  good 
sources  of  information  about  personnel  changes  and  the  structure  of 
review  authority  within  districts.    They  also  were  highly  informative 
in  the  matter  of  the  various  testing  programs  going  on  in  the  state  and 
the  research  climate  in  general.    In  the  case  of  initial  refusals,  some 
coordinators  made  special  efforts  to  persuade  unwilling  districts.  In 
California,  for  example,  the  State  Coordinator  encouraged  his  superior, 
the  Director  of  the  Program  Evaluation  and  Research  Division,  to  write 
directly  to  two  reluctant  superintendents.    One  of  the  two  was  swayed, 
and  we  obtained  limited  participation  upon  recontacting  that  district. 
In  New  York,  the  State  Coordinator  helped  establish  contacts  with 
appropriate  persons  in  the  New  York  City  Board  of  Education,  so  that  a 
lengthy  and  demanding  review  process  could  be  initiated  in  the  most 
efficient  way.    in  Texas,  the  State  Coordinator  was  able  to  point  to  c 
substitute  district  that  was  like  a  refusal  district  in  overall 
characteristics  but  was  less  overburdened  by  testing  commitments  than 
the  refusal  district,  and  which  had  a  management  structure  conduci  .  to 
making  a  prompt  decision  about  participation.    That  district  was  added 
to  the  sample.    The  same  sbrt  of  advice  was  sought  in  another  state, 
although  in  that  instance  the  district  recommended  by  the  State 
Coordinator  refused  and  was  also  unpersuaded  by  the  coordinator's 
direct  appeal. 

Coordinators  several  times  stressed  their  limited  effectiveness  as 
persuaders  of  districts,  and  some  district  personnel  expressed 
resentment  that  state  research  personnel  who  were  imposing  substantial 
state  testing  burdens  upon  them  should  then  be  the  ones  to  urge  them  to 
take  on  yet  another  such  burden.    Overall,  however,  State  Coordinators 
proved  a  vital  asset,  and  contributed  substantially  to  the  success  of 
the  field  test  in  the  public  schools. 


1.3.4         Securing  District  Cooperation 


Eighty-two  schools  were  sampled  from  the  .,ve  NELS:88  field  test 
states  (see  Section  1.2,  The  Field  Test  Sample;  Design  and  Respondent 
Selection).    This  report  will  discusr  these  schools  as  two  samples— lue 
52  school  eighth  grade  school  sample  and  the  30  school  high  school 
sample.    Tables  1-1A  and  1-1B  summarize  the  breakdown  of  the  eighth 
grade  and  high  school  samples  by  school  type  (thut  is,  public, 
Catholic,  or  other  private  sector). 


ERIC 


53 


TABLE  1-1A 

EIGHTH  GRADE  SCHOOLS  IH  HBLS:88  FIELD  TEST  ORIGINAL  SAMPLE 

Counts  by  School  Type 


SCHOOL  TYPE 

PUBLIC      PRIVATE  CATHOLIC 

TOTAL 

ORIG. SAMPLE 

M 

40              6  6 

52 

Z 

76.92Z      11.54Z  11.54Z 

100. OOZ 

TABLE  1-1B 

HIGH 

SCHOOLS  IN  NELS:88  FIELD  TEST  ORIGxNAL  SAMPLE 

Counts  by  School  Type 

SCHOOL  TYPE 

PUBLIC      PRIVATE  CATHOLIC 

TOTAL 

ORIG. SAMPLE 

N 

22              2  6 

30 

Z 

73.33Z       6.67Z  20.00Z 

100. OOZ 

1.3.4.1  Procedures 


The  40  public  eighth  grade  schools  and  the  22  public  high  schools 
in  the  sample  represented  31  districts.    In  September,  district 
superintendents  ware  notified  by  letter  (see  List  of  Appendices) 
explaining  the  objectives  of  the  study  and  asking  for  cooperation  and 
approva*  to  contact  the  schools  in  their  districts  included  in  the 
sample.    A  follow-up  phone  call  was  made  by  NORC  to  answer  any 
questions  district  personnel  might  have  and  to  ascertain  the  district's 
decision.    This  follow-up  phone  call  was  usually  made  by  central  office 
contact  staff,  with  the  Project  Director  and  Associate  Project  Director 
available  for  advice  or  intervention  if  problems  arose.    In  the  case  of 
Catholic  schools,  a  letter  of  notification  about  the  study  was  sent  to 
each  appropriate  diocese  informing  these  officials  that  NORC  would  be 
contacting  certain  schools  to  participate  in  the  NELS.88  field  test. 
Ho  follow-up  phone  call  was  made  to  the  Catholic  dioceses. 
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1.3.4.2  Problems 


Problems  were  encountered  with  several  of  the  large  school 
districts  that  were  contacted.    u/»de  County,  Florida  was  reluctant  to 
ask  school  principals  to  consider  allowing  another  research  effort  to 
be  conducted  in  their  schools.    School  principals  felt  that  the 
previous  NAEP  had  been  seriously  oisadninistered  and  were  consequently 
hostile  to  ths  idea  of  more  testing  in  their  schools.  The 
Superintendent's  office  thought  that  time  needed  to  pass  before  schools 
cou*d  be  approached  again.    Since  Dade  County  would  almost  certainly  be 
dravn  in  the  Base  Year  sample,  the  Superintendent's  office  thought  that 
fiel    :est  research  should  be  conducted  elsewhere  and  that  the  district 
office  could  have  more  positive  influence  on  behain  of  the  study  in 
1988  if  NB7S:88  kept  out  of  Dade  County  in  1987. 

!os  Angeles  Unified  wai  another  district  that  initially  refused  to 
participate  in  the  Jield  test  because  schools  were  overburdened 
generally  and  undergoing  a  heavy  l^ad  of  testing.    "";e  study  was 
reviewed  by  the  district  personnel  and  the  primary  objection  raised 
concerned  the  disproportionate  representation  of  Los  Angeles  Unified 
District.    (MORc,  of  course,  had  never  intended  to  draw  a  state- 
representative  samp,  in  California.    As  explained  in  ":ction  1.2,  for 
each  field  test  state  only  two  Unties  were  sampled.)    Upon  persuasion 
from  NORC  personnel,  the  California  State  Coordinator  and  Alexander  Law 
(Director,  Program  Evaluation  and  Research  Division,  California  State 
Department  of  Education),  the  district  agreed  to  choose  one  school  to 
participate  in  the  study;  because  the-e  was  a  long  review  and  appeal 
process  in  the  Los  Angeles  Unified  District,  NORC  was  delayed  in 
contacting  substitute  schools  for  the  five  schools  that  needed 
replacing.    This  delay  forced  us  to  extend  the  contacting  phase  of  the 
field  test.    Other  Los  Angeles  County  Districts  refused  because  of 
heav)  testing  schedules.    We  were  told  by  Long  Beach  School  District 
that  the  fall  was  too  late  to  contact  their  schools  for  scheduling; 
schools  in  that  district  want  notification  as  early  as  late  spring  of 
the  preceding  school  year. 

Queens  County;  New  York,  required  an  extensive  project  review. 
This  review  created  delays  in  the  schedule  (see  section,  1.3.5,  below, 
Specie'  Case  of  New  York  City). 

1.3.4.3       Outcomes  in  Public  Districts 

The  40  public  eighth  grade  schools  in  the  smple  re  pre    ^ted  31 
districts.    Phone  follow-up  to  these  district  superintende  resulted 
in  the  cooperation  of  24  districts.    One  district,  the  Los  i*3 
Unified  District,  while  agreeing  to  cooperate,  would  not  allow  u«  to 
directly  contact  the  six  schools  sampled.    Instead,  the  district  found 
one  eighth-grade  school  that  volunteered  no  participate.    One  district: 
in  New  York  informed  ilORC  that  a  decision  could  not  be  made  by  the 
dir  rict  until  the  study  was  formally  approved  by  the  Office  of 
Educational  Assessment  of  the  New  York  School  Board. 
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Six  districts  refused  to  cooperate  for  the  following  princ  yal 
reasons: 

Overburdened  with  other  testing, 

not  notified  soon  enough,  and  the  fact 

that  this  was  "just"  a  field  test  ,  1 

District  overburdened  with  testing. 

Hostility  felt  at  school  level,  owing  to 

the  schools'  (and  district's)  perception  that  the 

previous  NAEP  had  been  seriously 

misadmini*tered  1 

Overburdened  with  other  testing,  and 

the  timing  was  bad  3 

Superintendent  felt  the  study  placed 

too  ttuch  work  on  schools  1 

No  refusals  were  motivated  by  objections  to  the  test  or 
questionnaire  contents.    New  York  City,  however,  did  object  to  the  test 
and  questionnaire  ccntent,  but  agreed  to  cooperate  if  changes  were  made 
or  items  stricken  for  New  York  City  administration. 

1.3.5      Special  Case  of  New  York  City 

New  York  Ci'y  represents  a  special  case  in  the  matter  of  securing 
cooperation.  While  many  larger  districts  are  administratively  complex 
and  may  require  detailed  and  time-consuming  review  by  a  research  and 
evaluation  committee  or  by  district  specialists,  in  no  other  field  test 
site  was  the  review  process  so  lengthy  (four  months)  or  so  extensive  as 
in  New  York  City.    Nor  did  we  encounter  elsewhere  the  number  and 
magnitude  of  restrictions  on  conduct  of  the  survey  imposed  by  the  New 
York  City  Board  of  Education.    However,  the  Board's  Office  of 
Educational  Assessment  was  unstintingly  helpful  throughout  the  process, 
and  made  many  special  efforts  to  accommodate  the  survey's  needs. 

Because  the  New  York  City  system  has  both  a  highly  ramified 
central  bureaucracy  and  decentralized  subdistricts  administered  with  a 
high  degree  of  autonomy  by  their  own  superintendents  and  local  school 
boards,  lines  of  authority  are  often  unclear.    Our  initial  contacting 
effort  was  aimed  at  five  of  the  semi -autonomous  subdistricts:  four 
community  school  districts  containing  eighth  grades  and  the  Queens  High 
School  District.    One  subdistrict  refused  to  participate.    Officials  of 
three  subdistricts  felt  that  we  needed  no  central  board  approval  to 
proceed  with  the  fi«ld  test,  but  a  community  school  district  with  two 
selected  eighth  grade  schools  insisted  that  we  must  have  Bo*  d  of 
Education  approval  before  they  could  continue  discussions  with  us. 
With  the  help  of  the  New  York  State  Coordinator,  we  contacted  the 
Office  of  Educational  Assessment  of  the  New  York  City  Board  of 
Education. 
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The  Office  of  Educational  Assessment  agreed  to  begin  the  review 
process  at  once  and  asked  us  to  send  copies  of  all  questionnaires,  a 
copy  of  the  cognitive  test  battery,  copies  of  explicit  consent  forms, 
draft  letters  to  district  superintendents  and  principals,  and  a 
proposal  for  conducting  field  work  in  New  York  City.    These  materials 
were  sent  via  Federal  Express  overnight  delivery  on  October  22,  1986. 
The  study  was  discussed  at  the  next  meeting  of  the  review  committee 
(November  15,  1986)  and  it  was  decided  that  while  the  study  would  be 
approved,  restrictions  would  be  imposed  on  both  the  content  of  the 
instruments  and  the  methods  for  data  collection.    Modifications  needed 
to  be  worked  out  in  detail  before  approval  could  be  formalized.  The 
Office  of  Educational  Assessment  generously  allowed  us  to  contact 
schools  while  the  review  of  the  study  continued.    Despite  this  fact, 
the  subdistrict  that  had  insisted  on  Board  of  Education  approval  would 
not  permit  us  to  contact  schools  in  its  jurisdiction  until  they  had 
received  formal  written  notice  of  final  approval  from  the  Board  of 
Education* 


The  Board  of  Education  asked  for  the  following  changes: 

e       Modification  of  the  parent  and  student  information  materials 
to  put  added  emphasis  on  the  sensitive  content  areas  in  the 
student  and  parent  questionnaires  (frr  example,  family 
•tructure,  financial  data,  health  problems),  and  to  lay 
additional  stress  on  the  possibility  of  being  asked  to 
participate  in  follow-up  studies. 

e       Use  of  explicit  parental  consent  only  (that  is,  no  principal 
or  aubdistrict  superintendent  would  be  allowed  to  opt  for 
implied  consent). 

e       Modification  of  specific  items  c„  the  cognitive  test  battery. 

e       Modification  of  specific  items  on  the  questionnaires. 

e       Disallowal  of  certain  data  collection  procedures.  These 
included  telephone  or  in-person  follow-up  of  parents  in 
connection  with  outstanding  explicit  permission  forms  or  the 
parent  questionnaire,  and  telephone  retrieval  of  missing  data 
from  the  parent  questionnaire  unless  th&  respondent  had 
provided  a  telephone  number  for  this  purpose. 

These  proposed  changes  were  negotiated.  The  Office  of  Educational 
Assessment  was  extremely  open  to  discussion  of  all  substantive  and 
procedural  issues.  On  the  cognitive  test  battery,  one  reading  passage 
taken  from  NAEP  was  modified  so  that  "troll"  replaced  the  word  "devil. 
We  successfully  argued  for  the  need  to  keep  the  religious  preference, 
financial  background,  and  education  ccjts  questions,  and  for  retaining 
the  locating  questions,  with  the  exception  of  (on  the  student 
questionnaire)  home  telephone  number  and  name,  address  and  phone  number 
of  a  close  friend  or  relative.    We  argued  unsuccessfully  for  allowing 
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principals  to  choose  the  method  of  implied  consent,  and  for  allowing 
telephone  follow-up  of    irents  to  obtain  permission  forms  and  prompt 
for  return  of  the  parent  questionnaire.    Sines  survey  forms  were  still 
under  OMB  review,  it  was  agreed  that  the  questionnaires  would  be 
resubmitted  for  a  final  New  York  City  review  after  Any  changes  imposed 
by  OMB  had  been  effected,  and  that  the  Mew  York  St at, •-sponsored 
supplemental  questions,  still  under  development,  would  also  be 
submitted  for  review.    However,  one  major  unresolved  issue  remained, 
namely,  approval  by  the  Board* s  legal  office  of  the  request  for  rosters 
containing  the  names  of  students  enrolled  in  the  eighth,  tenth  or 
twelfth  grade  in  the  selected  New  York  City  public  schools. 

Review  of  the  study  by  the  legal  office  took  considerable  calendar 
time  and  their  approval  was  not  granted  until  January  16,  1987. 
Fortunately,  this  approval  will  extend  through  the  base  year  and 
NBLS:88  will  not  have  to  undergo  a  second  legal  review  in  New  York 
Cicy.    Once  this  approval  had  been  extended,  the  Office  of  Educational 
Assessment  immediately  requested  its  central  computer  facility  to 
generate  copies  of  the  newly-updated  student  rosters  for  >ur  use  in  the 
selected  schools.    However,  owing  to  other  demands  on  the  computer 
facility,  rosters  were  provided  to  us  only  on  March  10,  1987.  (The 
Office  of  Educational  Assessment  has  requested  further  discussions  of 
the  timing  and  extent  of  our  roster-generation  needs  for  the  base  year, 
so  that  they  can  be  sure  those  needs  can  be  met  in  a  timely  and 
efficient  fashion.) 

Formal  approval  to  conduct  the  field  test  in  the  New  York  Public 
Schools  wan  granted  in  a  letter  from  the  Director  of  the  Office  of 
Educational  Assessment,  February  6,  1987. 

Lengthy  though  the  review  process  was  in  New  York  City,  there  is 
reason  to  suppose  that  approval  can  be  achieved  more  quickly  in  the 
base  year.    Legal  review  will  not  be  required.    Questionnaire  review 
can  move  quickly,  if  base-year  changes  in  the  field  test  instruments 
are  not  extensive.    NORC  has  established  close  relationships  with  the 
principal  actors  in  the  review  process,  and  the  New  York  Board  is  well 
aware  of  the  special  value— to  them  and  to  the  state  education 
department— of  the  Net?  York  State  instrument  and  sample  augmentation. 

In  addition,  we  have  begun  to  discuss  the  field  test  results  with 
the  Office  of  Educational  Assessment.    They  have  expressed  a  strong 
interest  in  working  closely  with  us  to  ensure  the  success  of  the  study 
in  1988.      We  believe  that  the  evidence  of  the  field  test  points 
strongly  toward  the  conclusion  that  the  requirement  of  explicit 
parental  consent,  especially  when  coupled  with  disallowal  of  telephone 
prompting  for  permission  forms,  will  be  damaging  to  the  study  in  New 
York  City  in  the  base  year.    We  also  continue  to  feel  that  in  orde*  to 
maintain  data  comparability  between  New  York  City,  the  rest  of  New  York 
State,  and  the  nation — and  in  order  to  obtain  needed  locating 
information  for  the  1990  follow-up—it  is  desirable  that  no  content 
changes  be  imposed  on  the  tests  or  questionnaires.    The  New  York  Board 
is  especially  concerned  that  the  itudy  bp  implemented  with  due 
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attention  to  the  linguistic  diversity  of  Mew  York  City  eighth  graders 
and  their  parents,  and  we  will  be  discussing  with  then  the  prospects 
for  translating  parent  contact  and  permission  documents  into  Spanish 
and  additional  languages,  and  will  be  exploring  the  desirability  of 
Spanish-language  editions  of  questionnaires. 


1.3.6       Securing  School  Cooperation 


1.3.6.1    School  Contact  Procedures 

School  contacting  for  the  NBLS:88  field  tust  was  dc  te  by  both 
central  office  personnel  and  NORC's  field  staff.    It  was  telt  that  in 
some  cases  a  local  contact  from  someone  living  in  the  school's 
community  would  be  an  advantage  to  gaining  the  cooperation  of  the 
school.  In  other  cases,  it  was  felt  that  contacting  could  be  more 
successfully  effected  by  NORC's  central  office  staff,  with  their  more 
intimate  understanding  of  the  research  goals  of  the  study.    All  mail 
contact  with  the  school  was  from  NORC's  central  office.  Telephone 
follow-up  to  individual  schools  was  made  by  central  office  staff  and 
NORC's  field  staff. 

The  first  step  in  contacting  a  school  was  to  send  materials  to  the 
school  principal  explaining  the  study,  asking  for  his  or  her 
cooperation  in  allowing  the  school  to  participate,  and  informing  the 
principal    aat  he  or  she  would  be  contacted  by  one  of  NORC's  staff  to 
discuss  the  project.    All  letters  were  sent  from  NORC,  and  phone 
contact  with  the  principal  was  initiated  one  week  later  by  either  the 
field  (a  senior  Pield  Manag  r)  or  central  office  (an  Assistant  Survey 
Director).      In  schools  where  phone  follow-up  was  effected  by  the 
field,  the  Field  Manager  was  supervised  by  a  central  office  staff 
person.    The  central  office  representative  forwarded  a  case  to  the 
field  when  it  was  ready  for  phone  contact.    All  subsequent  mail  contact 
to  school  was  written  in  the  central  office,  copied  for  the  contacting 
field  person,  and  sent  on  to  the  school.    Principals  who  agreed  to  hai e 
their  schools  participate  were  asked  to  choose  a  date  for  the  Survey 
Day  and  the  Make-up  Day.    They  were  also  asked  to  designate  some  me  to 
act  as  school  coordinator  for  the  project.    Finally,  type  of  permission 
required  by  the  school  was  discussed.    In  many  cases  the  principal 
decided  to  act  as  the  School  Coordinator  and  other  pertinent  issues 
were  discussed  at  this  time. 

Public  Schools:    Eighth  Grade 

From  the  24  districts  that  agreed  to  have  schools  contacted,  25 
junior  high  school  principals  were  sent  letters  explaining  the 
objectives  of  the  study  and  asked  to  allow  their  school  to  participate. 
As  shown  in  Table  1-2A,  21  schools  agreed  to  participate  and  entered 
the  field  test  stud/.    One  school  was  ineligible  becau*»  it  no  longer 
contained  an  eighth  grade.    The  four  schools  that  refused  did  so  for 
the  following  reasons: 

20 


59 


Involved  with  other  testing 
Pelt  it  was  too  Much  work.. 


3 
1 


Public  Schools:    High  Schools 

Fifteen  high  school  principals  were  also  sent  letters  explaining 
the  objectives  of  the  study  and  asked  to  have  sophomores  and  seniors  in 
their  school  participate  in  the  field  test.    As  shown  in  Table  1-2B, 
twelve  schools  agreed  to  participate  and  entered  the  study.    The  three 
schools  refused  because  the  principals  thought  there  was  too  much 
burden,  especially  for  a  study  that  targets  eighth  graders. 

Substitutions 

District  refusals  and  school  refusals  resulted  in  the  need  for 
school  substitutions.    School  substitutions  were  normally  made  from 
replicate  samples  except  in  two  instances.    In  Texas  a  district  was 
chosen  for  us  by  the  State  Coordinator  after  four  districts  from  the 
replicates  were  contacted  and  refused  tn  participate,  and  in  California 
one  district  with  two  eighth-grade  schools  was  recruited  into  the 
sample  by  one  of  NORC's  field  staff.    Some  substituted  schools  were  in 
districts  that  had  already  agreed  to  cooperate,  while  others  required 
that  a  new  district  contact  be  initiated.    Twenty-nine  eighth  grade 
school  substitutions  were  needed  before  17  schools  finally  agreed  and 
entered  the  sample.    District  and  school  refusals  were  primarily  based 
on  the  reasons  mentioned  above. 

In  several  cases,  schools  could  have  accommodated  the  study  if  the 
field  period  had  been  longer.    While  in  the  base  year  it  will  be 
practical  to  have  a  longer  field  period,  the  field  test  dates  were 
constrained  by  the  deadlines  for  the  field  test  report  and  RES,  FEDAC, 
and  OMB  review  of  the  revised  instruments. 

In  California,  where  the  delays  occasioned  by  the  lengthy  Los 
Angeles  and  Long  Beach  reviews  had  slowed  down  the  schedule  seriously, 
some  districts  were  approach  unofficially  to  identify  a  suitable  site 
that  could  make  a  prompt  decision  before  one  such  district  co:ld  be 
identified.    Also  in  California,  the  private  school  sample  was 
increased  by  o-ie  school  because  the  extensive  time  that  would  have  been 
needed  to  initiate  the  formal  district  and  public  school  contacting 
procedure.    When  all  contacting  was  finally  complete,  38  public  eighth 
grade  schools  (95  percent  of  our  target  M)  and  26  public  high  schools 
(86  percent  of  the  target  N)  agreed  to  cooperate.    While  the  final 
school  N  was  slightly  under  the  original  targets,  it  was  felt  that  with 
reasonable  in-school  participation  rates  this  N  should  yield  numbers 
within  the  required  test  observation  levels.    It  was  therefore  decided 
to  add  no  further  schools.    However,  when  twelfth  grade  participation 
rates  subsequently  proved  lower  than  hoped,  and  some  tests  were  lost  in 
the  mail,  a  special  supplemental  twelfth  grade  session  was  arranged  in 
Chicago. 
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Catholic  School  Contacting 

Letters  were  ^ent  to  six  junior  high  principals  and  six  high 
school  principals  of  Catholic  schools  informing  them  of  the  objectives 
of  HBLS:88  and  asking  them  to  participate  in  the  field  s.udy.  Three 
eighth-grade  schools  and  three  high  schools  agreed  to  participate  and 
entered  the  sample  (see  Table*  1-2A  and  1-2B).    The  remaining  six 
schools  refused  for  the  following  reasons: 


Eighth  grade  schools: 
School  was  busy  undergoing 

accreditation  

Principal  concerned  that  the  study 

looked  to  be  too  time  consuming  and 

did  not  like  the  idea  that  parents  would  be 

asked  to  participate  1 

School  was  involved  in  a  Jesuit 

ljngitudinal  study  1 

High  schools: 

Timing  was  not  righc  „  \ 

School  felt  that  a  government  stud> 

would  not  benefit  a  Catholic  institution  1 

School  did  not  have  adequate  space  1 


Substitute  schools  were  chosen  from  replicate  samples.    Six  eighth 
grade  and  six  high  school  substitutes  were  contacted  before  three 
eighth-grade  schools  and  two  high  schools  agreed  to  cooperate  and 
entered  the  sample.    Catholic  high  schools  in  Du  Page  County,  Illinois, 
were  uncooperative.    All  five  high  schools  were  contactedf  and  no 
school  would  agree  to  participate.    One  of  these  schools  had  a  standing 
rule  that  it  did  not  allow  researchers  into  the  school.    All  of  the 
others  did  not  have  the  time  to  devote  to  the  study  because  of  other 
standardized  testing.    Eighth-grade  Catholic  schools  in  Queens  county 
also  proved  to  be  difficult.    Of  the  three  schools  sampled,  none  would 
participate  owing  to  the  fact  that  they  thought  the  survey  too 
burdensome.    Pinally,  the  Diocese  was  asked  to  help,  and  a  school  was 
chosen  to  participate.    The  six  eighth  grade  schools  represent  100 
percent  of  the  original  target  sample  N  of  six.    The  five  high  schools 
represent  83  percent  of  the  original  target  N  of  six  (see  Table  1-2A 
ard  1-2B). 
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Private  School  Contacting 


Six  eighth  grade  principals  and  two  high  school  principals  of 
private  schools  received  a  letter  inviting  them  to  participate  in  the 
NELS:88  field  test.    Table  1-2A  shovs  that  three  eighth-grade  schools 
agreed  to  participate  and  entered  the  sample.    Table  1-2B  shows  that 
one  high  school  agreed  and  entered  the  sample.    One  eighth-grade  jchool 
was  ineligible  because  it  is  a  facility  for  mentally  and  physically 
handicapped  children.    The  two  eighth-grade  schools  and  one  high  school 
refused  participation  for  the  following  reasons: 


School  undergoing  accreditation  1 

School  was  overburdened  with  other 

testing.  2 


Bight  substitute  eighth  grade  schools  and  one  substitute  high 
school  were  contacted  and  five  schools  (four  junior  highs  and  one  high 
school)  entered  the  sample.    One  substitute  was  ineligible  because  it 
was  a  learning  disability  facility.    Two  refused  because  the  survey 
demanded  too  much  time  from  school  personnel.    One  refused  to  give  a 
reason  for  not  participating.    The  seven  private  eighth  grade  schools 
represent  116  percent  of  the  target  sample  N  of  six.    The  two  private 
high  schools  represent  100  percent  of  the  target  N  of  two. 
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TABLE  1-2 A 

EIGHTH  GRADE  SAMPLE  REALIZATION  BY  SECTOR 

SCHOOL  TYPE  PUBLIC      PRIVATE    CATHOLIC  TOTAL 

ORIG.  SAMPLE       H  40  6  6  52 

*  76.92Z      11.54Z     11.54Z  100. 00Z 

AGREED  21  3  3 

52.5  Z     50.0  Z     50.0  Z 

REFUSED  4  2  3 

10.0  Z     33.3  Z     50.0  Z 

DIST  kEPUSAL  10 

25.0  Z 

DIST  RESTRICTIONS  4 

10.0  Z 

INELIGIBLE  1  l 

2.5  Z      16.7  Z 


SUBSTITUTIONS  29  8  6 

AGREED  17  4  3 

58.6  Z     50.0  Z     50.0  Z 

REFUSED  4  3  3 

13.8  Z     37.5  Z     50.0  Z 

DIST  REFUSAL  8 

27.6  Z 

INELIGIBLE  1 

12.5  Z 


TOTAL  N  38 


51 


Z  of  original    95.00Z    116. 67Z      100. 00Z  98.08Z 
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SCHOOL  TYPE 
ORIG. SAMPLE 

AGREED 

REFUSED 

DIST  REFUSAL 


TABLE  1-2B 
HIGH  SCHOOL  SAMPLE  REALIZATION  BY  SECTOR 

PUBLIC      PRIVATE  CATHOLIC 

N  22  2  6 

Z  73.33Z       6.67Z  20.00Z 

12  1  3 

54.6  Z     50.0  Z     50.0  Z 

3  1  3 

13.6  Z     50.0  Z     50.0  Z 

5 

22.7  Z 


DIST  RESTRICTIONS 

INELIGIBLE 

SUBSTITUTIONS 
AGREED 

REFUSED 

DIST  REFUSAL 

INELIGIBLE 


2 

9.1  Z 


14  1  6 

7  1  2 

50.0  Z    100.0  Z     33.3  Z 


3 

21.4  Z 
4 

28.6  Z 


4 

tj.7  Z 


TOTAL 


30 
100. 00Z 


TOTAL  N  19  2  5 

Z  of  original    86.36Z    100. 00Z  83.33Z 
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TABLE  1-3 


PINAL  ALLOCATION  OP  SAMPLE 

SCHOOLS  TO 

STATES  AND 

SECTORS 

Eighth  Crade  Schools 

State 

Public 

Catholic 

Other 
Private 

Total 

New  York 

Sth  Gr  Enr 

6 

2 

i 

9 

Queens 

23,000 

3 

1 

I 

5 

Erie 

15,000 

3 

1 

0 

4 

Plorida 

6 

1 

1 

8 

Pain  Beach 

£,000 

6 

0 

0 

6 

Dade 

23,000 

0 

1 

1 

2 

Illinois 

7 

1 

1 

9 

Du  Page 

11,000 

5 

1 

1 

7 

Adams 

1,400 

2 

0 

0 

2 

Texas 

9 

1 

1 

11 

Harris 

43,000 

6 

1 

1 

8 

Trinity  group  2,000 

3 

0 

0 

3 

California 

10 

1 

3 

14 

Solano 

4,000 

3 

0 

0 

3 

Los  Angeles 

119,000 

5 

1 

3 

9 

San  Diego 

2 

0 

0 

2 

TOTAL  33  6  7  51 
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TABLE  1-3  (CON1?) 
Teiuh-Twelf th  Grade  Schools 


Other 


State 

Public 

Cathol ic 

Pri  vate 

Total 

New  York 

4 

2 

1 

7 

Queens 

2 

2 

0 

4 

Brie 

2 

0 

1 

3 

Florida 

4 

0 

o 

L 

Palm  Beach 

4 

0 

o 

4 

Dade 

0 

0 

o 

0 

Illinois 

3 

0 

o 

3 

Du  Page 

2 

0 

o 

2 

Adams 

1 

0 

o 

1 

Texas 

4 

1 

0 

5 

Harris 

3 

1 

0 

A 

Trinity  group 

1 

0 

0 

1 

California 

4 

2 

1 

7 

Solano 

1 

0 

0 

1 

Los  Angeles 

3 

2 

1 

6 

San  Diego 

0 

0 

0 

0 

TOTAL 

19 

5 

2 

26 

27 
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TABLE  1-3  (CON'T) 
All  Schools 

Other 


State 

rUDUC 

Cattiol  ic 

Private 

Total 

New  York 

i  n 
ill 

H 

16 

Oiip  en  a 

c 
J 

*% 

3 

9 

Brie 

C 
J 

1 

7 

Florida 

l 

12 

P*lm  Reach 

i  n 
ill 

0 

10 

Dade 

u 

1 

2 

Illinois 

i  n 

1 

12 

Du  Page 

7 

i 
l 

9 

Adams 

3 

0 

3 

Texas 

13 

2 

! 

16 

Harris 

9 

2 

12 

Trinity  group 

4 

0 

0 

4 

California 

14 

3 

4 

21 

Solano 

4 

0 

0 

4 

Los  Argeles 

8 

3 

4 

15 

San  Diego 

2 

0 

0 

2 

TOTAL 

57 

11 

9 

77 

28 
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1.3.6.2       Trea:ment  of  Nonresponding  Schools 


We  attempted  to  convert  all  districts  and  schools  lhat  initially 
refused  to  participate  in  the  NELS:88  field  test.    The  general  approach 
involved  was  to  emphasise  our  willingness  to  work  within  the  school's 
schedule  and  to  offer  assistance  by  our  field  staff  for  clerical  duties 
normal ly  assumed  by  the  school  coordinator. 

The  schools  and  districts  that  gave  mild  resistance  at  first  were 
easily  persuaded  by  the  precise  detailing  of  what  was  involved  and  our 
desire  to  minimise  inconvenience  to  the  school.    In  some  instances  a 
district  sought  to  find  a  replacement  school  when  the  sampled  school 
would  not  participate. 

We  had  difficulty  converting  schools  and  districts  that  were 
already  burdened  with  other  testing.    The  principals  and 
superintendents  were  not  willing  to  take  on  a  burden  for  a  field  test. 
Many  expressed  the  view  that  our  chances  vould  be  better  for 
participation  in  the  base  year  if  we  did  our  field  testing  elsewhere. 
The  Los  Angeles  Unified  School  District  was  converted  but  reduced  the 
number  of  schools  (see  above).    In  two  school  situations  we 
successfully  convinced  schools  to  cooperate  only  to  have  them  back  out 
later  in  the  field  period  because  they  perceived  the  study  to  place  too 
heavy  a  burden  on  the  school. 

One  incentive  that  could  not  be  offered  in  the  field  test  but 
might  be  made  available  in  the  base  year  is  the  return  of  school  level 
0r  df1^"  level  data,  with  a  national  comparison  point.    Some  schools 
specifically  requested  to  see  some  sort  of  data  from  the  field  test. 


1.3.6.3     Types  of  Schools  Least  Likely  to  Cooperate 

Certain  areas  of  the  country  seemed  harder  to  obtain  cooperation 
in  than  others.    Harris  County  (Houston)  had  four  districts  refuse 
because  o^  involvement  with  other  testing.    Los  Angeles  County  also 
seemed  overburdened  with  the  California  Assessment  testing  and  district 
level  testing,  and  its  high  schools  were  involved  in  the  new  Golden 
State  Exams.    The  type  of  schools  least  likely  to  cooperate  were  small 
Christian  private  schools  and  small  Baptist  private  schools.    Some  were 
persuaded  to  enter  the  sample  by  the  argument  that  they  were  a  rare 
school  type  that  needed  to  be  included  in  the  study  if  we  were  to 
achieve  a  true  picture  of  contemporary  American  schooling,  and  that 
their  unique  characteristics  very  much  needed  to  be  represented  in  the 
data.    Even  when  the  priw  ;e  Baptist  schools  agreed  to  participate  they 
•^ad  very  poor  attendance  on  Survey  Day  due  to  denial  of  parental 
permission.    Although  we  hai  expected  Catholic  schools  to  be  more 
cooperative  than  public,  in  the  event  they  turned  out  to  be  less  so. 
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1.3.6.4       Characteristics  of  Pinal  School  Sample 


The  characteristic*  of  the  final  51  schools  that  made  up  the 
eighth  grade  cohort  of    he  NELS:88  field  test  are  the  followinr: 


39  public  schools,  of  which  33  were  from  urban  counties  and  5 
from  iural  counties 

7  urban  other  private  schools:  1  had  approximately  98 
percent  Hispanic  enrollment,  2  were  Baptist  schools,  2 
Lutheran  schools,  1  Christian  school,  and  J  elite  private 

6  urban  Catholic;  1  had  100  percent  black  enrollment 

The  26  high  schools  consisted  oft 

2  rural  public  schools 

5  urban  Catholic  schools:  1  boys*  school,  1  girls*  school,  3 
co-ed  schools 

2  urban  other  private  schools. 

1. 3.6.5       Re  commend  at  ioi.*  and  Conclusions 

District  --....acting  should  be  done  early  and  the  names  of  the 
sampled  schools  should  not  necessarily  be  included  in  this  initial 
contact.    We  found  during  the  field  test  that  when  some  districts  were 
initially  contact**  and  told  which  schools  were  selected,  the  district 
proceeded  to  contacc  the  schools  for  thair  opinion.    In  nany  c-  s  tiiis 
procedure  helped  us  because  the  district  informed  us  that  the  school 
would  gladly  participate  and  our  next  phone  contact  with  the  school  was 
not  tv  persuade  but  to  gather  information  and  set  up  the  survey.  In 
retrospect  this  gain,  other  than  the  gain  in  schedule  time,  was 
insignificant  because  these  were  very  cooperative  schools  and  most 
probably  would  have  participated  j-st  knowing  that  the  district  had 
been  notified  and  had  net  objected.    In  other  cases,  though,  where 
schools  were  unwilling  to  participate,  the  district  informed  us  that 
the  school  was  unwilling  and  would  not  allow  us  to  proceed  to  contact 
them  directly.    We  were  not  seeing  a  district  refusal  but  a  school 
refusal.    We  had  no  control  ovc*  how  the  material  was  presented  to  that 
school,  nor  were  we  given  any  chance  to  try  to  convert  the  school.  Of 
course,  in  practice  it  is  likely  that  distucts  often  will  ask  to  know 
the  schools  that  have  hcen  selected,  and  district  officials  will  often 
want  tc  consult  with  schools.    In  such  situations  it  may  prove 
beneficial  to  send  school-specific  materials  to  the    t    ricts  along 
with  the  names  of  the  selected  schools  to  be  forwara_j  co  the 
principals. 
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When  contacting  school  principals,  phone  fjllow-up  should  ideally 
be  made  within  a  few  days  after  the  principal**  ^ceipt  of  our  initial 
contact  letter.    In  field  test  schools  where  more  than  a  few  days  had 
e«apsed  we  found  that  a  remailing  of  materials  was  necessary,  thus 
deUying  the  contacting  schedule  needlessly. 

When  discussing  the  permission  issue  with  principal:  in  the  field 
test,  we  usually  asked,  "What  type  of  permission  is  required  in  your 
school?"    In  Many  cases,  the  principals  chose  explicit  consent  without 
realising  how  hard  the  tracking  effort  would  be  for  both  the  school  and 
NORC.    If  possible,  we  could  send  a  copy  of  the  implied  consent  form 
stating  that  if  the  schools  had  any  objections  to  that  form  they  should 
discuss  it  with  us.    Most  schools  will  probably  accept  that  form  after 
seeing  it,  unless  constrained  by  district  or  state  polic    to  use 
explicit  consent.    In  addition,  our  field  test  experien^    will  enable 
us  to  document  the  difficulties  of  explicit  consent  in  a  way  that 
should  prove  convincing  to  principals  in  the  base-year  study. 

The  principal  usually  chose  a  r-hool  Coordinator.    We  asked 
principals  to  inform  these  persons  of  their  selection  before  we  made 
contact  wi'Ji  them.    In  many  cases,  the  principal  informed  these 
coordinates  of  their  assignment  but  did  not  give  them  all  of  the 
materials  explaining  the  study  in  detail.    It  would  be  desirable  to 
have  a  School  Coordinc':or  Manual  to  send  in  one  base-vear  survey—a 
method  used  in  US&B.    This  manual  would  contain  an  ove    lew  of  the 
study  and  descriptions  of  tasks  arranged  by  time  span  prior  to  Survey 
Day.    Often  School  Coordinators  indicated  that  they  wanted  to  know 
exactly  what  they  were  going  to  have  to  do  from  the  beginning.  The 
manual  would  help  them  to  be  organised. 

Additional  materials  should  bp  'veloped  to  enhance  effectiveness 
in  dealing  with  religious  schools.    Our  arrangements  for  close 
cooperation  with  NCSA,  and  the  interest  of  the  High  School  and  Beyond 
data  for  policy  makers  and  researchers  in  the  Catholic  sector,  will 
facilitate  making  an  effective  appeal  to  Catholic  schools.    The  small 
religins  academies  will  constitute  a  special  challenge  in  1988  because 
they  oi    n  are  fearful  of  Federal  studies,  see  little  benefit  from 
them,  &id  have  no  centralized  authority  that  can  be  appealed  to  for 
help  in  persuasion. 

In  general,  we  found  that  a  strategy  of  flexibility  was  the  most 
effective  way  to  deal  with  refusals,  both  at  th<;  district  and  the 
school  level.    We  stressed  -he  immense  value  of  NELS:88  and  the 
relatively  minimal  demands  on  class  time  for  a  limited  number  of 
students  and  teachers.    We  pointed  out  that  NORC  field  staff  would 
shoulder  much  of  the  survey  burden  in  the  schc  1.    The  honorarium  to 
School  Coordinators  was  an  effective  gesture.    We  made  scheduling 
flexible  to  accommodate  the  school—this  was  more  difficult  to  do 
within  the  compressed  field  period  of  the  pretest  than  it  will  be  in 
rhe  base  year.      nere  preparation  of  roster  or  matrices  seemed  a 
problem,  we  offered  to  pay  for  clerical  time  or  to  send  a  member  of  our 
field  staff  to  help.    In  many  instances  these  strategies  were 
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successful.    In  others  they  were  not.    The  most  intractable  esses 
seemed  to  be  refusals  base'  on  fears  that  r -search  and  testing  already 
encroached  too  severely  on  classroom  time  and  school  manpower.  Given 
the  simultaneous  occurrence  of  other  national  studies  of  schools  as 
well  as  stace  and  district  mandated  testing  and  evaluation  programs 
(especially  at  eighth-grade  level),  seci   \ng  school  and  district 
cooperation  will  be  a  formidable  task  for  the  base-year  study. 

1»4       Obtaining  Parental  Permission 

When  a  school  was  recruited  into  our  sample  the  principal  was  asked 
about  the  type  of  permission  required  from  the  parents  to  allow  the 
students  to  take  part  in  this  type  of  study.    If  there  was  no  state  or 
district  policy  requiring  explicit  permission,  an  argument  for  implied 
permission  was  made.    It  was  pointed  out  to  the  principal  that  the 
implied  permission  fori?  did  not  compromise  the  rights  of  parenrs  to 
object  to  their  child1  s  participation  in  the  study.    On  the  other  hand, 
the  explicit  form,  while  not  adding  extra  protection,  would  adversely 
affect  th    jverall  participation  rate  of  respondents,  and,  therefore, 
damage  the  quality  of  research  and  data  collection.    He  could  never  be 
sure  if  an  ui*re turned  form  represented  an  informed  decision  against 
participation.    Tracking  unreturned  forms,  we  stressed,  could  be 
expensive  and  time  consuming. 

Fourteen  of  the  51  eighth  grade  schools  required  explicit 
permission.    One  required  no  permission  at  all.    The  regaining  36 
schools  chose  to  use  the  implied  permission  form.    Of  the  26  high 
schools,  seven  required  explicit  permission,  one  required  no  permission 
and  18  used  the  implied  permission  form. 


Implied  Consent  Procedures 

^      The  procedure  for  obtaining  parental  permission  was  to  mail 
"student  packets9'  containing  the  permission  form  to  the  School 
Coordinator  approximately  four  weeks  before  Survey  Day  (see  List  of 
Appendices).    These  packets  were  to  be  distributed  to  the  students  at 
school.    The  student  war.  told  to  take  the  form  hesss  to  his  parents,  An 
envelope  was  supplied  for  the  parents  to  return  the  permission  form 
directly  to  NORC  if  they  chose  to  deny  permission. 

Results 

Generally  this  method  worked  quite  well.    However,  in  some  cases 
the  School  Coordinator  did  not  distribute  the  packets  immediately  upon 
receiving  them.    This  delay  gave  patents  less  time  to  respond  before 
Survey  Day  end  consequently  some  forms  reached  NORC  after  a  Survey  Day 
had  taken  place  in  the  school.    The  importance  of  distributing  these 
materials  immediately  will  have  to  be  empnasized  to  all  School 
Coordinators  in  the  base  year. 
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Some  parents  also  misunderstood  the  nature  of  the  implied  consent 
form,  and  returned  the  form  unsigned  or  crossed  out  the  word  NOT  in 
order  to  explicitly  give  their  permission,    Perhapu  the  addition  of  one 
line  saying  only  to  return  the  form  if  the  parent  objected  to  the 
child's  participation  would  clarify  this  minor  point. 

In  both  the  eighth  grade  schools  and  the  high  schools,  all  but  one 
School  Coordinator  using  the  implied  form  were  happy  to  have  NORC  track 
the  r    urned  permission  forms.    One  junior  high  school  in  Texas  chose 
to  us*  the  implied  consent  form,  but  the  coordinator  then  felt  uneasy 
and  had  all  the  students  return  the  form  to  him.    If  a  parent  was  not 
objecting,  therefore  returning  an  unsigned  form,  the  coordinator  asked 
the  parents  to  initial  the  bottom  so  he  was  sure  they  had  seen  the 
£orm.    In  effect,  he  was  using  explicit  permission.    One  week  prior  to 
Survey  Day,  NORC  wrote  both  the  School  Coordinator  and  field 
representative  to  report  the  status  of  permission  for  the  students  to 
be  surveyed.    On  the  day  prior  to  Survey  Day  the  NORC  team  leader  was 
brought  up  to  date  on  permission  statu*  to  reflect  any  changes  that  had 
occurred  after  tb-  official  permission  stilus  letters.    This  update  was 
then  communicated  verbally  to  the  School  Coordinator  on  Survey  Da/. 

Explicit  Consent  Procedures 

The  procedure  for  get<*ing  permission  forms  to  parents  was  the  same 
as  described  above  for  implied  consent  except  that  we  allowed  five 
weeks  for  the  parents  to  return  permission  forms.    The  two  New  York 
City  Queens  public  high  schools,  though,  were  unwilling  to  hand  out 
these  materials  to  the  students  in  school.    The  school  coordinator  felt 
it  was  a  burden  to  do  this  task  and  assumed  that  the  majority  of  forms 
would  never  reach  home.    Consequently  NORC  mailed  the  permission  forma 
directly  to  parents  at  home  addresses  provided  on  the  student  roster. 
Queens  County,  New  York,  modified  the  explicit  permission  form  for  use 
in  Queens  public  schools.    See  List  of  Appendices  for  copies  of  the 
explicit  forms. 

Results 

Explicit  permission  proved  to  be  a  difficult  procedure  for  both 
NORC  and  School  Coordinators.    Some  of  the  eighth-jrade  school 
coordinators  decided  to  track  permission  themselv€ s  without  notifying 
NORC  of  this  change  in  procedure.    Having  discovered  th.j,  we  noticed 
that  having  School  Coordinators  tra:k  explicit  permission  forms  cid  in 
fact  improve  ths  return  of  these  forms,    Parents  and  students  were  more 
likely  to  return  the  forms  to  someone  they  knew  at  the  school  rather 
than  to  an  unknown  institution  in  Chicago.    Also,  the  Schoi 1 
Coordinator  was  able  to  follow  up  on  unreturned  forms  quickly.  During 
the  course  of  the  field  period  we  then  asked  the  School  Coordinators 
whose  smools  required  explicit  permission  to  help  us  by  having  the 
forms  returned  directly  to  them.    Most  School  Coordinators  < ^reed  to  do 
this.    Even  with  this  help  not  every  student  had  a  form  returned  by 
Survey  Day  (See  Table  1-4a).    Understandably  enough,  the  School 
Coordinators  wanted  to  interpret  "no  form  returned"  as  permission 
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denied.    As  a  matter  of  fact,  however,  we  usually  found  that  when  a 
form  was  not  returned,  it  was  only  because  the  parent  had  forgotten. 
Some  School  Coordinators  were  persuaded  to  keep  trying  to  obtain  a 
permission  form  *o  that  students  in  this  ambiguous  status  would  be  able 
to  participate  in  the  survey  on  Make-up  Day.    In  seven  eighth  grade 
cases  the  students  were  unable  to  participate  because  no  explicit 
permission  form  had  been  returned. 

Tie  difficulty  of  explicit  permission  tracking  in  high  schools  was 
compounded  by  the  large  number  of  students  that  the  coordinator  had  to 
track.    Fortunately,  these  large  school  numbers  will  not  be  a  feature 
of  NBLS:88  or  follow-up  studies.    Scliool  Coordinators  in  high  schools 
were  also  less  likely  to  help  by  having  the  foncs  returned  directly  to 
them.    In  high  schools  where  they  did  track  the  permission  forms,  they 
were  surprised  at  how  hard  it  was  to  do  this.    One  high  school  decided 
to  interpret  no  form  being  returned  as  an  implied  granting  of 
permission  ihen  on  Survey  Day  only  20  percent  of  the  forms  had  been 
returned. 

In  3  high  schcjls  that  required  explicit  permission,  the  number  of 
forms  returned  by  Survey  Day  was  so  small  that  new  permission  forms  and 
letters  to  parents  were  distributed  again.    This  effort  by  the  COS  and 
School  Coordinator  was  very  time-consuuing. 

Both  Queens  public  high  schools  required  explicit  permission.  One 
school  was  very  willing  to  help  with  permission  tracking.  The 
coordinator  decided  to  have  all  forms  returned  directly  to  him.  The 
school  used  its  computerised  phone  message  system  to  contact  parents 
and  urge  the*  to  return  the  forms        grant  permission  for  their 
children  to  participate.    The  parents  had  21  days  in  which  to  return 
their  form.    One  week  prior  to  Survey  Day  another  letter  was  sent  to 
each  parent  urging  the  parent  to  respond,  and  another  perrunsion  form 
was  enclosed.    Still,  on  Survey  Day  at  that  school  only  33  percent  of 
the  sophomores  and  21  percent  of  the  seniors  had  a  signed  form  and 
could  participate.    The  school  officials  refused  to  have  a  Make-up  Day, 
stating  that  they  could  think  of  no  other  effort  to  persuade  parents  to 
return  th^ir  consent  forms.    The  other  Queens  h?gh  school  was  not  as 
cooperative  in  helping  us  obtain  permission  from  parents.    Even  though 
the  School  Coordinator  was  persuaded  to  have  permission  forms  returned 
directly  to  him  so  he  could  monitor  closely  '.he  return  of  the  forms,  he 
did  nothing  to  assist  when  forms  were  not  h*ing  returned.    One  week 
prior  to  Survey  Day  only  five  fonua  had  bee:i  returned,  and  these  forms 
had  been  mailed  to  NORC  directly.    When  NORC  asked  if  the  coordinator 
would  be  willing  to  distribute  a  second  permi>;uion  form  along  with  a 
plea  letter  from  CBS  urging  parents  to  sign  an/J  return  the  form 
promptly,  he  agreed.    However,  NORC1 a  te*a  leader  found  out  on  Survey 
Pzy  that  he  never  distributed  this  second  ^oim.    Consequently,  96 
percent  of  the  consent  forms  remained  unreturned  on  Survey  Da^ 
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Permission  Denial 


Eighth  Grade  Schools 

Please  refer  to  Table  1-4A  for  the  following  discussion  of  denials. 

In  public  schools  there  were  56  permission  denials,  representing 
4.8  percent  of  the  eligible  students.    This  figure  includes  49 
permissions  ;hat  were  denied  and  7  cases  where  no  permission  form  was 
returned  and  the      idents  were  not  allowed  to  participate.    Of  the  49 
denials,  one  student  was  converted  by  the  team  leader  at  an  Orientation 
Day  session  and  subsequently  had  permission  granted  and  participated  in 
the  study.    Tiro  parents  were  converted  and  the  students  participated  in 
Survey  Day.    One  other  student  that  had  permission  denied  turned  out  to 
be  a  student  that  had  transferred  out  of  the  school.    It  is  unknown 
whether  the  parent  denied  permission  because  of  the  fact  that  the 
student  would  nc  longer  be  at  the  school  or  because  the  parent  objected 
to  the  study. 

In  the  Catholic  schools  there  were  4  permission  denials,  which 
represents  2.3  percent  of  the  eligible  students.    One  of  these  students 
was  converted  by  the  team  leader  and  participated  in  Survey  Day. 

In  the  other  private  schools  there  were  27  permission  denials, 
which  represents  14.7  percent  of  the  eligible  students.    Pour  of  these 
students  were  converted  and  participated  in  Survey  Day. 

The  total  number  of  permission  denials  :n  all  types  of  schools  was 
87,  or  5.7  percent  of  the  eligible  students. 

There  were  1,201  core  students  eligible  to  participate  in  Surv«y 
Day.    Pifty-eight  students  (4.8  percent)  had  permission  denied.    Of  the 
215  eligible  Hispanic  students,  as  defined  by  school  roster 
annotations,  20  had  permission  denied  (9.3  percent).    The  sampled  Asian 
group,  as  defined  by  school  roster  annotations,  had  111  eligible 
students  and  9  (8.1  percent)  had  permission  denied. 

High  Schools 

Please  refer  to  Table  1-4B  for  the  following  discussion. 

In  public  tenth  grades  2.7  percent  of  the  students  in  schools 
requiring  implied  permission  and  4.8  percent  of  the  students  in  schools 
requiring  explicit  permission  had  permission  denied,  bringing  the 
overall  permission  denial  in  public  schools  to  3.0  percent.    In  the 
public,  tenth  grades  we  also  :iaw  that  52.4  percent  of  the  explicit 
permission  forms  were  not  retimed  by  Survey  Day  and/or  Make-up  Day, 
preventing  151  sophomores  fron  participating  in  the  sr.udy. 

In  the  private  schools  asing  implied  permission,  1.4  percent  of  the 
students  had  permission  denied,  while  in  private  schools  using  expli  it 
permission  12.1  percent  of  the  students  had  permission  denied.  Two 
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students  (3.5  percent)  were  unable  to  participate  in  the  study  because 
their  permission  forms  were  not  returned. 


In  Catholic  schools  only  implied  permission  was  used,  and  1.3 
percent  of  the  tenth  graders  were  denied  permission. 


TABLE  1-4A 


PERMISSION  DENIALS  -  EIGHTH  GRADE  COHORT 
BY  SAMPLED  JROUP  AND  SCHOOL  TYPE 


SAMPLED 

GROUPS 

PROM 

SCHOOL 

ROSTER 


ASIAN 
denials 
eligible 


HISPANIC 
denials 

eligible 


SCHOOL  TYPE 
CATHOLIC       PRIVATE  PUBLIC 


0  (0.0Z)  3  (21. 4Z)  6  (6.7X) 
8  14  89 


3  (5.7Z)  10  (23. 3Z)  7  (5.9Z) 
53  43  119 


TOTAL 


?  (8.1Z) 
111 


20  (9.3Z) 
215 


CORE 
denials 
eligible 


1  (0.9Z)      14  (11. 0Z)    43  (4.5Z)  58  (4.8Z) 

113  127  961  1201 


TOTAL 
denials 
eligible 


4  (2.3Z)      27  (14. 7Z)    56  (4.8Z)  87  (5.7Z) 

174  184  1169  1527 


There  were  1,465  tenth  graders  eligible  to  participate  in  the 
study.    Forty-three  (2.9  percent)  had  permission  denied. 

In  public  twelfth  grades,  4.0  percent  of  the  students  in  schools 
requiring  explicit  permission  and  5.8  percent  of  the  students  in 
schools  requiring  explicit  permission  had  permission  denied,  bringing 
the  overall  permission  denial  in  public  twelfth  grades  to  4.5  percent. 
In  the  public  twelfth  grades,  62.1  percent  of  the  explicit  permission 
forms  were  not  returned  by  Survey  D  y  and/or  Make-up  Day,  preventing 
182  seniors  from  participating  in  the  study. 
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In  private  schools  using  implied  permission,  4.4  percent  of  the 
students  had  permission  denied,  while  in  private  schools  using  explicit 
permission  15.0  percent  of  the  students  had  permission  denied. 

In  Catholic  schools  where  only  implied  permission  was  used,  2.2 
percent  of  the  twelfth  graders  were  denied  permission. 

There  were  1,452  eligible  seniors  for  the  NELS:88  field  test. 
Sixty-six  (4.5  percent)  had  permission  denied. 


Conversions 


The  implied  permission  form  provides  a  space  for  parents  to  supply 
their  telephone  number  and  refers  to  the  fact  that  someone  from  NORC 
night  get  in  touch  with  them  to  discuss  the  permission  issue.  One 
school  coordinator  objected  to  this  part  of  the  permission  form,  and 
for  this  particular  school  the  form  was  modified  to  state  that 
providing  a  telephone  number  was  completely  voluntary. 

Conversion  was  attempt  -d  for  8  parents  of  eighth  grade  students. 
Three  of  these  parents  were  converted  (37.5  percent),  and  the  students 
participated  in  Survey  Day.    In  thr  e  cases  NORC  was  informed  by  the 
parents  that  they  did  not  object  to  the  study  but  were  denying 
permission  as  requested  by  their  child. 

The  explicit  permission  form  (except  for  the  version  ussd  in 
Queens,  NY  public  schools)  also  had  a  space  to  provide  a  telephone 
number.    Generally,  schools  requiring  explicit  permission  did  not 
approve  our  desire  to  attempt  a  conversion  with  the  parents.  One 
School  Coordinator  in  Brie,  NY,  would  not  allow  NORC's  team  leader  to 
call  the  parents  of  t%o  students  who  had  denied  permission,  but  instead 
offered  to  call  himself,    Neither  of  these  parents  were  converted. 
Pour  parents  of. students  in  a  private  school  in  California  were 
converted  by  phone  on  Make-up  Day.    One  student  who  requested  his 
parents  deny  permission  was  converted  after  attending  an  Orientation 
Day  presentation. 

It  was  difficult  to  even  attempt  conversions  in  many  cases  because 
permission  forms  arrived  at  NORC  only  1-2  day?  prior  to  Survey  ^ay.  If 
the  school  required  a  Make-up  Day  to  be  held,  conversion  attempts  were 
made.    In  most  schools,  though,  no  Make-up  Day  sessions  were  held. 
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TABLE  1-4B 
PERMISSION  DENIALS  -  HIGH  SCHOOL  COHORT 


CATHOLIC 


PRIVATE 


PUBLIC 


TOTAL 


10th  grade 

IMPLIED  CONSENT 

denials 
eligible 

EXPLICIT  CONSENT 
denials 
no  forms 
eligible 


3  (1.3Z) 
233 


NA 


2  (1.4Z) 
143 


7  (12. 1Z) 
2  (3.5Z) 
58 


20  (2.7Z) 
743 


11  (4.8Z) 
151  (52. 4Z) 
288 


25  (2.2Z) 
1119 


18  (6.3Z) 
153  (44. 2Z) 
346 


TOTAL 


denials 
eligible 


3  (1.3Z) 
233 


9  (4.5Z) 
20) 


31  (3.0Z) 
1031 


43  (2.9Z) 
1465 


12th  grade 

IMPLIED  CONSENT 

denials 
eligible 

EXPLICIT  CONSENT 
denials 
no  forms 
eligible 


5  (2.2Z) 
233 


NA 


6  (4.4Z) 
137 


9  (15. 0Z) 
0  (0.0Z) 
60 


29 
729 


'4.0Z) 


17  (5.8Z) 
182  (62. 1Z) 
293 


40  (3.6Z) 
1039 


23  (6.5Z) 
182  (51. 6Z) 
353 


TOTAL 


denials 
eligible 


5  (2.2Z) 
233 


15  (7.6Z) 
197 


46  (4.5Z) 
1022 


56  (4.5Z) 
1452 


1.5      Interviewer  Recruiting  and  Training 

Recruiting  and  hiring  of  the  Team  Leaders  for  each  school  was  done 
by  NORC's  experienced  Field  Managers,  under  the  supervision  of  a 
District  Pit  d  Manager  and  the  Central  Office  Staff.    The  Field 
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Managers  first  attempted  to  hire  interviewers  who  had  worked  on  the 
HS&B  bast  year  and  firat  follow-up,  since  these  interviewers  had 
specific  experience  with  education  longitudinal  studies  and  with  group 
school  administration  of  questionnaires  aid  tests.    They  were  able  to 
hire  29  percent  of  their  field  staff  with  this  experience.    FMs  then 
recruited  other  interviewers  experienced  in  group  interviewing  or 
testing  of  young  people,  either  through  other  NORC  studies  such  as 
Profiles,  or  through  studies  done  by  other  companies.  Twenty-four 
percent  of  the  Team  Leaders  hired  reflected  that  level  of  experience. 
The  FMs  then  recruited  other  NORC  irterviewera  who  did  not  have 
experience  on  group  administrations.    Again,  24  percent  were  hired  at 
this  level.    Pinally,  the  FMs  recruited  outside  the  NORC  interviewer 
pool.    When  possible,  they  hired  former  teachers  or  others  with  similar 
relevant  skills.    Of  the  remaining  23  percent,  14  percent  had  previous 
teaching  experience.    A  special  point  of  interest  (to  be  addressed  in 
Chapter  2)  was  whether  all  four  groups  of  interviewers  would  prove 
equally  successful  in  conducting  the  field  wor) 

As  Team  Leaders  were  hired  they  were  assigned  to  specific  schools. 
Bach  Team  Leader  was  responsible  for  approximately  four  schools.  Since 
school  contacting  was  still  occurring  at  this  time,  some  Team  Leader* 
were  assigned  tentatively  to  schools.    If  a  particular  school  did  net 
participate  or  if  more  schools  were  added  after  hiring,  the  Team 
Leaders  were  reassigned  to  the  new  schools.    Care  was  taken  when 
scheduling  schools  to  limit  the  number  scheduled  for  the  sane  day. 
Once  an  interviewer  had  been  hired  for  the  Team  Leader  position,  s/he 
was  sent  project  specific  training  materials.    NORC  has  used  self-study 
training  with  interviewers  in  many  studies  and  it  has  proven  to  be  a 
reliable  and  inexpensive  training  technique.    The  training  materials 
were  developed  jointly  by  th>  central  office  and  the  field,  combining 
the  expertise  into  a  comprehensive  project-specific  manual.  These 
materials  were  all  reviewed  and  approved  by  the  CES  project  officer. 

Training  materials  included  discussions  of  all  aspects  of  the  study 
and  the  expected  role  of  the  Team  Leader.    Included  among  the  more 
standard  sections  were  sections  on  the  special  aspects  of  dealing  with 
eighth  graders,  the  overall  objectives  of  a  longitudinal  study,  and  the 
procedures  for  hiring  clerical  assistants.    At  the  end  of  each  section, 
a  summary  listed  the  major  themes  and  guidelines.    The  manual  also 
included  &  set  of  self-tests  designed  for  Team  Leaders  to  test  their 
own  knowledge  of  the  material.  Instructions  were  included  to  review  any 
materi  il  incorrectly  answered  in  the  self-tests.    Once  the  Team  Leaders 
had  gone  through  the  training  and  self-tests,  they  would  contact  their 
Field  Managers.  The  Field  Managers  would  then  review  the  materials  and 
test  the  Team  Leaders  using  questions  designed  to  insure  that  all  Team 
Leaders  were  adequately  trained  to  go  into  the  schools.  These 
questions  deslt  both  with  issues  of  procedure  and  with  challenging 
situations  that  might  arise  in  dchools. 

Team  Leaders  were  also  instructed  to  hire  their  own  Clerical 
Assistants  to  assist  them  :i  the  schools.    These  Clerical  Assist*  \ts 
had  the  responsibility  of  giving  general  clerical  support  to  the  Team 
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Leader.    Included  were  teaks  such  as  passing  out  questionnaire  booklets 
and  tests,  and  completing  the  critical  item  edit  during  the  testing 
session.    Teas  Leaders  were  encouraged  to  hire  people  they  knew 
personally,  such  as  husbands,  children,  other  relatives,  or  good 
friends.    All  potential  Clerical  Assistants  had  to  be  approved  by  the 
Pield  Managers.    Once  Clerical  Assistants  had  been  hired,  they  were 
given  a  sm^ll  manual  explaining  what  their  duties  world  be  and  how  to 
do  a  critical  item  edit.    The  training  was  not  expected  to  take  more 
than  an  hour.    Team  Leaders  were  instructed  to  tes'.  the  Clerical 
Assistants  to  make  sure  they  understood  their  responsibilities  *nd  the 
procedures.    The  Clerical  Assistant  materials  Included  a  section  on 
confidentiality  and  its  role  in  survey  research.    They  were  instructed 
to  read  and  sign  the  NORC  confidentiality  statement.  Team  Leaders  were 
instructed  to  review  the  importance  of  confidentiality  with  them. 
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CHAPTER  2:    STUDENT  DATA  COLLECTION 
2.1  Overview 

This  chapter  describes  student  data  collection  procedures—and 
assesses  their  success.    Data  collection  activities  aimed  at  other 
Respondents,  such  as  teachers  and  school  administrators  are  discussed 
in  subsequent  chapters.    This  discussion  of  student  data  collection 
follows  two  main  paths.    The  first  is  an  examination  of  student 
response  rates.    The  second  is  a  description  of  field  test  procedures 
for  recruiting  and  training  the  data  collectors,  and  of  procedures  for 
conducting  the  orientation,  survey,  and  make-up  sessions. 

Within-school  student  response  rates  offer  one  perspective  from 
which  to  judge  the  success  of  survey  procedures;  they  are  also  useful 
in  evaluating  the  Orientation  Day  experiment,  which  sought  to  determine 
whether  holding  an  orientation  session  would  positively  influence 
student  participation  or  in  other  ways  contribute  to  the  success  of  the 
student  survey.    Eighth,  tenth,  and  twelfth  grade  response  rates  are 
reported,  as  well  as  response  rates  for  Orientation  Day  and  no 
Orientation  Day  schools.    Response  rates,  both  for  the  total  eighth 
grade  population  and  for  the  two  groups  of  schools  in  the  orientation 
experiment,  are  also  broken  down  and  examined  by  sample  echnicity 
(Core,  Hispanic,  Asian-Pacific  Islander),  school  sector  (public, 
Catholic,  other  private)  and  by  region  (the  five  field  test  states,  and 
New  York  City).  ' 

These  procedures  and  event*  are  assessed  in  terms  of  information 
and  judgments  gathered  in  debrief ings  of  the  School  Coordinators,  Field 
Manager*  and  Team  Leaders,  and  NELS:88  project  staff,  as  well  as  in 
written  reports  of  CES  observers. 

2.2      Individual  Response  Rates 

2.2.1      Eighth  Grade  Cohort 


The  overall  completion  rate  for  the  eighth  grade  was  92  percent. 
Although  a  maximum  of  32  students  were  t'rawn  per  school,  the  final 
sample  size  averaged  30  eligible  students  per  school,  of  which  an 
average  of  27.6  participated.    This  is  attributed  to  sample  attrition 
and  inclusion  of  schools  with  fewer  than  32  eighth  graders. 

The  following  discussion  will  report  participation  rates  for  the 
eighth  grade  cohort  of  the  field  test  in  further  detail.  Completion 
rates  by  the  sampled  groups,  according  to  ethnicity  as  annotated  on  the 
student  roster,  will  be  compared,  then  participation  rates  across  the 
school  types  (public,  Catholic  and  other  private  sectors)  will  be 
addressed.    Ethnicity  and  school  sector  are  also  considered  in  the 
analysis  of  the  results  for  schools  participating  in  the  Orientation 
Day  session  against  those  schools  with  no  Orientation  Day  session. 
Participation  by  region  is  given  as  well.  (Participation  rates  are 
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reported  for  each  of  the  five  MELS:88  field  test  states.    However,  New 
York  City  public  eighth  grades  were  calculated  separately  to  show  how 
they  differed  from  the  re»t  of  New  York  State.)    Finally,  a  list  of 
completion  rates  by  individual  schools  is  included. 

2.2.1.1     Completion  Rates,  Sampled  Groups,  Orientation  Day  versus  No 
Orientation  Day 

The  students  for  the  NBLS:88  fieU  test  were  drawn  from  three 
ethnically  distinct  sample  types:    Asian-Pacific  Islander  (API), 
Hispanic  (HIS) ,  and  core  (see  section  2.1).      Response  rates  are  first 
presented  for  these  groups.    Two  questions  are  posed  in  this 
comparison:    Were  there  significant  differences  in  response  rates  among 
the  three  populations?    Did  the  Orientation  Day  session  have  more 
impact  on  the  Survey  Day  participation  of  any  one  of  these  groups  than 
on  the  others? 


There  were  119  eligible  API  students,  215  eligible  HIS  students, 
and  1,196  eligible  core  students  (as  designated  on  the  sampling  roster 
provided  by  schools),  for  a  total  of  1,530  eligible  eighth  grade 
students.    Table  2-1  shows  completion  rates  for  the  three  groups  of 
students  where  an  Orientation  Day  in  the  school  was  not  held  versus 
where  an  Orientation  Day  was  held,  and  the  overall  completion  rates  tor 
these  three  groups,  regardless  of  their  participation  in  an  Orientation 
Day. 

The  Orientation  Day  appears  to  have  had  a  small  positive  effect 
for  Asian-Pacific  Islanders.    Of  the  119  eligible  API  students,  71  of 
these  students  had  no  Orientation  Day  and  63  of  these  students,  or  88.7 
percent,  completed  questionnaires  and  tests  on  Survey  Day.    Of  the  48 
eligible  API  students  in  schools  where  an  Orientation  Day  session  was 
held,  44  students,  or  91.7  percent,  completed  questionnaires  and  tests. 
The  overall  completion  rate  for  the  Asian  Pacific-Islander  group  as 
shown  is  89.9  percent. 

Orientation  Day  seems  also  to  have  had  a  modest  positive  effect  on 
Survey  Day  attendance  for  Hispanic  students.    There  were  215  eligible 
Hispanic  students  fot  the  NELS:88  field  tests  and  90.7  percent  of  these 
students  participated  in  the  NELS:88  field  test.    Some  110  of  these 
students  were  in  schools  with  no  Orientation  Day  and  105  students  were 
in  schools  that  held  an  Orientation  Day  session.    The  completion  rates 
for  Orientation  Day  versus  no  Orientation  Day  were  92.4  percent  and 
89.1  percent  respectively. 

As  with  the  OBEMLA  supplementary  students,  Orientation  Day  seemed 
to  have  had  a  modest  positive  effect  for  students  in  the  Core  sample  as 
well.    Of  the  1,196  core  students  the  overall  completion  rate  was  92.5 
percent.    For  the  core  students  in  Or:entation  Day  schools  the 
completion  rate  was  94.2  percent.  For  the  core  students  in  schools  with 
no  Orientation  Day  the  completion  rate  was  91.7  percent. 
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We  can  see  that  there  is  a  difference  in  participation — albeit 
small — between  core,  API ,  and  Hispanic  students.    The  API  a..d  Hispanic 
students  had  approximately  a  90  percent  participation  rate,  which  was 
slightly  lower  than  the  92  percent  participation  rate  for  core 
students.    We  ^n  also  see  from  Table  2-1  that  Orientation  Day  has 


TABLE  2-1 


EIGHTH  GRADE 
PARTICIPATION  BY  SAMPLCD  GROUPS 
NO  ORIENTATION  DAY  VS.  ORIENTATION  DAY 


PinNIR 


OB  EM  LA 

API       No  ODay  4 

ODay  2 

Sub-Total  6 

HIS       No  ODay  6 

OD/»y  3 

Sub-Total  9 


QxCom 

63 
44 
107 


Absent       N  eligible 
Rate 


98 

07 
195 


4 
2 
6 


6 
5 

11 


71 
48 
119 


110 
105 
215 


Completion 

88. 7Z 
91. 7Z 
89.9a 


89. 1Z 
92. 4Z 
90. 7Z 


CORE      No  ODay  40 
ODay  10 
Sub-Total  50 


750 
356 
1106 


28 
12 
40 


818 
378 
1196 


91. 7Z 
94. 2Z 
92. 5Z 


TOTAL 

ALL  STUDENTS 


65 


1408 


PinNIR  -  Final  Non-Interviewed  Respondent 
QxCom  -  Questionnaire  Complete 


57 


1530 


92. 0Z 
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approximate*,  the  same  effect  on  all  of  the  groups—namely,  there  was  a  slight  increase 

participation  fov  all  types  of  students,  API,  HIS  and  core,  where  the  school  held  an 

Orientation  Day,  (See  Section  2.3.5  for  a  more  detailed  analysis  of  Ori.  tation  Day 
issues.)  7 

It  should  b*  noted  that  this  discussion  of  ethnicity  anc  completion  rates  >ased 
the  ethnicity  coded  by  the  School  Coordinators  at  the  time  the  student  roster  was  prepa 
In  Chapter  3  we  compare  roster  (school-reported)  and  questionnaire  (self-reported) 
ethnicity  and  report  their  degree  of  correspondence. 

2.2.1.2      Completion  Rates:  School  Type,  Orientatior.  Day  versus  No 
Orientation  Day 

The  NELS:88  field  test  school  sample  was  made  up  of  three  school 
types:    Catholic,  other  private,  and  public  schools.    The  following 
discussion  and  Table  2-2  will  compare  participatioi   in  these  three 
school  sectors  with  *nd  without  Orientation  Day  sessions. 

There  were  11?  eligible  eighth  graders  who  attended  Catholic 
schools  that  had  no  Orientation  Day.    The  participation  rate  for  these 
student**    u%  99.1  percent.    Pifr.y-four  students,  94.7  percent,  were 
surveyti  in  Catholic  jchools  that  did  hold  an  Orientation  Day  session. 
The  completion  rate  for  all  Catholic  students  was  97,7  percent. 

Of  the  138  eligible  students  in  other  private  schools  where  there 
was  no  Orientation  D^y,  111  students,  80.4  percent,  completed 
questionnaires  and  tests.    The  completion  rate  for  the  46  eligible 
students  attending  other  private  schools  that  held  an  Orientation  Day 
was  95.7  percent    fhe  completion  rate  for  all  other  private  eighth 
grade  students  <*as  84.2  psrceit. 

In  public  schools  that  did  not  hold  an  Orientation  Day  session, 
the  completion  rate  was  91.9  percent.    In  public  schools  that  had  an 
Orientation  Day  the  participation  was  93.2  percent.    The  participation 
for  all  eighth  graders  attending  public  schools  was  92.3  percent. 

Overall,  tLe  effects  of  Orientation  ^ay  appear  to  be  marginally 
positive.    However,  when  these  effects  r  —  broken  down  by  sector,  it 
appears  that  for  public  schools  there  was  a  very  small  (just  over  1 
percent)  participation  advantage  for  Orientation  Day.    For  Catholic 
schools,  attendance  was  actually  5  percent  higher  in  schools  that  did 
not  have  Orientation  Days.    This  negative  Orientation  Day  effect  for 
the  Cathoiic  sector  was  unanticipated.    In  othir  private  schools, 
however,  Orientation  Day  participation  was  a  dramatic  15  percent  higher 
than  in  schools  where  no  Orientation  Pay  took  place. 
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These  generalisations  for  the  private  sector  must  be  qualified  by 
the  snail  number  of  schools  on  which  they  are  based  (two  Catholic 
Orientation  Pay  schools  and  two  other  private  schools  with  Orientation 
Day),    Ana  indeed,  it  is^Surprising  that  the  effect  of  Orientation  Day 
appeared  to  be  negative  for  Catholic  schools.    We  have  no  way  to 
explain  this  outcome  and  suspect  chat  in  a  much  larger  Catholic  sector 
sample,  this  relationship  would  not  hold.    Certainly  in  the  public 
sector  as  a  whole,  the  positive  effect  of  Orientation  Day  appears  to  be 

TABLE  2-2 

EIGHTH-GRADE 
PARTICIPATION  BY  SCHOOL  TYPE 
NO  ORIENTATION  DhY  VS.  ORIENTATION  DAY 


PinNIR 


QxCom 


Absent       N  eligible 


Completion 
Rate 


SCHOOL  TYPE 

Catholic 

No  ODay 


ODay 

Sub-  Total 


0 
2 
2 


116 
5A 
170 


1 
1 

? 


117 
57 
17A 


99.17 
*A.7Z 
97  'Z 


Private 

No  ODay 


ODay 
Sub-Total 


20 
0 
20 


111 
AA 
155 


7 
2 
9 


138 
A6 
18A 


80. AZ 
95. 7Z 
8A.2Z 


Public 


No  ODay 
ODay 
Sub-Total 


30 
13 
A3 


68A 
399 
1083 


30 
16 
A6 


7AA 
A20 
1172 


91. 9Z 
93. 2Z 
92. 5Z 


TOTAL 

ALL  STUDENTS 


65 


1A08 


57 


1530 


92. OZ 


PinNIR  -  Pinal  Non-Interviewed  Respond" 
QxCom  -  Questionnaire  Complete 


A5 


9 
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to  small  that  the  cost  of  an  orientation  session  .      not  oe  justified 
in  terM  of  increased  Survey  Day  attendance  alone.    However,  the 
extremely  Urgt  field  test  impact  of  Orientation  Day  on  the  other 
private  sector  suggests  that  there  may  be  situations,  identifiable  in 
advance  by  school  type,  where  Orientation  Day  can  be  expected  to  have 
an  atypically  large  positive  effect  on  participation, 

2.2.1.3     Participation:    By  State 

The  following  table  shows  participation  of  eighth  grade  students 
by  field  test  state.    New  York  City  public  schools  have  been  calculated 
separately  from  the  rest  of  New  York  State,    The  New  York  City 
participation  rate  is  almost  ten  percent  lower  than  the  rest  of  t'  e 
it*"Tc.  He  exPected  *  lcwer  participation  rate  in  New  York  City  because 
explicit  permission  was  required  by  all  public  schools.    In  fact,  the 
rate  of  86.5  percent  that  was  achieved  in  the  New  York  C*fy  public 
eighth-grade  schools  was  higher  thun  expected.    ™iis  is  p.obably  due  to 
the  fact  that  the  School  Coordinators  for  these  public  schools  were 
very  cooperative—perhaps  atypically— and  helped  tremendously  in 
tracking  parental  permission,  repeatedly  sending  home  additional 
permission  forms  when  the  originals  were  not  returned.    It  is  difficult 
to  know  to  what  extent  this  limited  experience  of  New  York  City  eighth 
graders  cjo  form  the  basis  for  a  generalized  expectation  about  New  York 
City  in  the  base  year.    The  extremely  poor  participation  rates  for  New 
York  City  High  Schools  (see  _2.2  below)  introduces  a  note  of  caution 
into  expectations  about  levels  of  participation  in  that  locale. 


TABLE  2-3 


PARTICIPATION  BY  STATE 


State 

CA 

FL 

IL 

NYC 

NYS 

TX 

TOTAL 

eligible  N 

443 

249 

261 

89 

183 

305 

1530 

completed  N 

396 

235 

246 

77 

175 

279 

1408 

completion 
rate 

89. 4Z 

94. 4Z 

94. 3Z 

86. 5Z 

95. 6Z 

91. 5Z 

92.03 

46 


0 


85 


TABLE  2-4 

EIGHTH  GRADE  SCHOOLS  -  COMPLETION  RATE 
School  ID  Completion  Rate 

36  100. 00Z 

67  100. 00Z 

49  100. 00Z 
31  100. 00Z 

68  100.00Z 
53  100. 00Z 

50  100. 00Z 

40  97.44Z 
52  97.06Z 

28  96.97Z 

42  96.88Z 

41  96.88Z 
01  96.88Z 

12  96.77Z 
08  96.77Z 

06  96.67Z 

76  96.67Z 
30  96.55Z 

26  96.55Z 

03  96.55Z 

13  96.30Z 

14  96.30Z 

69  96.15Z 

51  94.12Z 
39  93.75Z 

27  93.75Z 
25  93.75Z 
56  93.55Z 

71  93.r5Z 

43  93.55Z 

77  93.33Z 

04  93.33Z 

07  90.63Z 
38  90.63Z 

70  90.63Z 
24  90.63Z 
83  90.63Z 

29  90.63Z 

73  90.00Z 
75  90.00Z 

10  87.5JZ 

72  87.50Z 

05  86.67Z 

54  85.71Z 
37  85.71Z 
02  85.11Z 

11  84.38Z 
59  81.25Z 

74  81.25Z 

55  80.00Z 
09  50.00Z 
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2.2.1.4     Completion  Rates:    ly  School 

Surtjury  and  Conclusions,  Eighth  Gr«:de  Schools 

Table  2-4  shows  completion  rates  by  eighth  grade  school. 

The  majority  of  eighth  grade  schools  experienced  very  high 
attendance  on  Survey  Day—on  average,  26  students.    Only  14  schools,  27 
percent,  required  Hake*  ip  Days  with  the  average  Make-up  Day  attendance 
being  4  students.    Generally,  it  appeared  that  School  Coordinators  had 
more  control  over  the  eighth  graders  than  over  high  school  students— 
if  permission  was  not  denied  rnd  if  they  were  not  absent,  the  students 
were  at  the  survey  session.    (Note:    School  ID  #09  was  an  Other  Private 
school.    The  SO  percent  participation  rate  was  due  to  parent il 
permission  being  denied  to  half  of  the  students. )2. 2. 2     High  School 
Cohort 

In  order  for  ETS  to  calibrate  the  cognitive  test  batteries, 
approximately  1,000  tests  were  desired  from  the  tenth  grade  cohort  as 
well  as  the  twelfth  grade  cohort.    In  the  field  period  1,126  sophomores 
and  969  seniors  were  surveyed  and  tested.    As  noted  in  section  3.3,  one 
box  of  completed  ques  ionnaires  and  tests  from  a  high  school  was  lost 
in  the  mail.    The  completion  rates  below  are  calculated  including  the 
numbers  of  questionnaires  in  the  lost  box  since  we  can.  document  the 
completion  rate*  at  the  school  whose  materials  were  lost  from  the 
completed  transmittal  form  provided  by  the  Team  Leader.    Even  taking 
into  account  the  lost  materials,  enough  sophomore  t»sts  were  obtained 
during  the  field  period.    The  low  participation  rate  of  seniors  and  the 
loss  of  materials  from  one  school  necessitated  a  special  session  for 
seniors  in  Chicago  in  which  an  additional  48  tests  were  obtained. 
Counting  the  special  session,  1,017  twelfth  graders  were  surveyed. 

2.2.2.1     Participation:    Tenth  Grade  by  State 

The  following  table  s  ows  participation  of  tenth  ^rade  students  by 
field  test  state.    New  York  City  public  schools  have  been  calculated 
separately  from  the  rest  of  New  York  State. 

TABLE  2-b 


TENTH 

PARTICIPATION 

BY  STATE 

State 

CA 

FL 

IL 

NYC 

NYS 

TX 

TOTAL 

eligible  N 

436 

226 

177 

112 

286 

287 

1524 

completed  N 

290 

192 

148 

24 

241 

236 

1131 

completion 
rate 

8A.9Z 

83. 6Z 

21. 4Z 

84. 3Z 

82. 22 

74. 21 

48 
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2.2.2.2      Participation:    Twelfth  Grade  by  State 


The  following  table  shows  participation  of  twelfth  grade  students 
by  field  test  state.    New  York  City  public  schools  have  been  calculated 
separately  from  the  rest  of  New  York  State. 

2.3       Data  Collection  Procedures 

Field  Test  Data  Collection 

The  following  section  provides  an  outline  and  assessment  of  the 
personnel,  structures,  forms,  and  procedures  used  in  field  test  dat* 

TABLE  2-6 


TWELFTH 

GRADE 

PARTICIPATION 

BY  STATE 

CHICAGO 

State 

CA 

PL 

IL 

NYC 

NYS 

TX 

SPECIAL 
SESSION* 

T~rAL 

eligible  N 

427 

221 

160 

117 

290 

293 

1508 

completed  N 

244 

156 

122 

15 

213 

219 

(48) 

969 

completion 

(1017 

r«te 

57. IX 

70. 1Z 

75. 62 

12. 8Z 

73. 5Z 

,4.7Z 

64.1 

*  Not  used  in  calculation  oi  response  rate. 

collection.    The  training,  characteristics,  and  performance  of  the 
field  staff  are  important  considerations  in  the  conduct  of  the  field 
test  and  are  assessed  here.    In  addition,  two  supervisory  structures 
were  utilized  during  the  field  period;  some  advantages  and 
disadvantages  of  each  structure  are  enumerated.    A  detailed 
presentation  of  the  procedures  used  in  each  of  the  major  contacts  with 
the  school  after  the  securing  cooperation  phaee,  and  «n  assessment  of 
the  effects  of  those  contacts,  are  provided.    Lastly,  the  procedures 
and  effects  of  the  Orientation  Day  experiment  involving  twent/  eighth 
grade  schools  are  examined. 

2.3.1      Field  Personnel 

Team  Leader  Performance 

Overall,  interviewers  were  highiv  regarded  by  their  NORC 
supervisors  and  t.e  School  Coordinators.    The  vast  majority  of  Team 
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Leaders  were  able  to  perform  in  an  exemplary  manner.    Discussions  with 
school  personnel  regarding  one  Team  Leader  recruited  from  outside  of 
HORC  revealed  difficulties  in  the  Team  Leader's  ability  to  maintain  the 
interest  and  enthusiasm  of  students  in  a  group  situation.    This  Team 
Trader  was  phased  out  of  the  project.    Still,  while  Team  Leaders 
possessed  variola  backgrounds  —  HS&B  experience,  group  survey 
adsiiniatration  experience,  or  teaching  —  all  groups  performed  well. 

After  the  close  of  field  activities,  we  debriefed  a  sample  of 
twenty-four  eighth-grade  School  Coordinators.    During  the  debriefing  we 
asked  each  of  the  coordinators  to  assess  the  conduct  of  our  Team 
Leaders  on  Survey  Dr  .    The  responses  are  listed  below,  in  Table  2-7: 


TABLE  2-7 

SCHOOL  COORDINATOR'S  ASSESSMENT  OP  TEAM  LEADER  ON  SURVEY  DAY 

Z 

School  Rated  Great 

Coordinator  &  Good  of 

Didn't  Those  Who 


Good 

Great 

Pair 

Poor 

Stay 

Total 

Stayed 

Introduction  

► . .  A  . . 

. .  9  . . 

..  2  . 

..  0  . 

• .  9  . .  < 

• . .  24  •  t 

..  86. 7Z 

.  ii .. 

..  4  . 

..  0  . 

■ .  2  •  •  < 

...  24  . 

.  31. 8Z 

Keeping  students  interested 

. .  3  . . 

. .  5  . . 

..  3  . 

.  .        1  .4 

.  71.4Z 

Explanation  *  

• .  A  •  • 

. .  3  .  • 

..  3  . 

..  0  ., 

.  12  ... 

...  24  .. 

..  75. 0Z 

Communicating  with  SC  

.  12  .. 

. .  9  . . 

..  0  . 

• .   3  .4 

»  •     0  mm* 

i . .  24  • « 

,.  87. 5Z 

.  39  .. 

.  12  . 

.  .       4       .  i 

,  3?  ... 

. .  120 

Z  of  those  who  stayed   

36. 8Z 

44. 8Z 

13.82 

4.6Z 

81. 6Z 

Team  Leader  attrition  was  also  kept  to  a  minimum— only  two  of  the 
twenty-two  interviewers  initially  hired  for  the  project  were  unable  to 
continue.    It  is  worth  noting  that  both  of  these  Team  Leaders  left  the 
project  before  training  had  begun  in  earnest,  so  that  costs  for 
training  these  Team  Leaders  were  not  incurred,    in  point  of  fact, 
expressed  as  a  percentage  of  Team  Leaders  that  actually  were  trained 
for  NELS:88,  the  attrition  rate  was  zero  percent. 

Clerical  Assistant  Performance 

One  experimental  feature  of  the  field  test  was  the  use  of  a 
Clerical  Ass  >tant  Ou  the  rurvey  team.    For  HS&B,  survey  teams  were 
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composed  of  two  field  interviewers.    For  the  NELSs  88  field  test,  each 
survey  team  was  composed  of  a  Team  Leader  and  a  Clerical  Assistant. 
The  Clerical  Assistant  was  responsible  for  the  critical  item  edit;  the 
Team  Leader  was  responsible  for  accomplishing  all  other  tasks  assigned 
to  the  survey  team,  including  hiring  and  directly  supervising  the 
f'i«ric  l  Assistant.    Over  the  course  of  che  field  period,  close 
attention  was  paid  to  qualitative  assessments  of  Clerical  Assistant 
performance,  che  Team  Leader -Clerical  Assistant  relationship,  and 
information  gathered  by  tlie  in  house  check  of  the  critical  item  edit. 
At  issue  was  the  ability  of  Teau  readers  to  hire  their  Clerical 
Assistants  in  consultation  with  their  Field  Managers,  the  possibility 
of  locating  suitable  candidates  for  the  Clerical  Assistant  position, 
and  the  level  of  monetary  inducement  necessary  to  secure  qualified 
per.  onnel. 

Team  Leaders  in  New  York  City  encountered  difficulty  in  finding 
Clerical  Assistants  and  retaining  them  threvghuut  the  field  period. 
One  Mew  York  City  Team  Leader  solved  this  problem  by  hiring  an  NORC 
interviewer,  suggesting  a  strategy  that  might  be  applicable  for  certain 
situations.    Two  other  Team  Leaders  in  New  York  shared  a  Clerical 
Assistant.    This  arrangement  did  not  work  as  well;  none  of  the  three 
were  pleased  with  the  work  situation.    Given  that  one  of  the  major 
advantages  of  the  Team  Leader-Clerical  Assistant  structure  is  that  the 
Team  Leader  is  able  to  hire,  in  consultation  with  the  Vield  Manager,  a 
person  with  whom  the  particular  Team  Le&Jer  would  like  to  work,  and 
given  that  this  hiring  decision  contributes  to  the  stability  of  role 
delineation,  it  seems  unwise  for  Te,\a  Leaders  to  share  Clerical 
Assistants.    This  assessment  is  supported  by  Team  Leader  appraisals  of 
their  relationship  to  their  Clerical  Assistant. 

At  all  other  sites  Team  Leaders  had  no  particular  difficulty  in 
hiring  ard  retaining  the  services  of  a  qualifier  Clerical  Assistant 
throughout  the  field  period.    In  many  cases,  daughters  or  spouses  of 
Team  Leaders  served  as  their  Clerical  Assistants.    This  arrangement 
facilitated  the  provisio  i  of  overnight  acc  xnmoda lions  where  necessary. 

There  were  no  reports  of  difficult  Te*nt  Leader-Clerical  Assistant 
relationships,  with  the  exception  ,*  the  shared  situation  discussed 
above.    Or.  the.  contrary,  Team  Leaders  reported  that  they  found  it  easy 
to  work  with  their  Clerical  Assistants.    Most  Team  Leaders  reported  no 
difficulty  in  maintaining  the  delineation  of  roles.    Indeed,  one 
advantage  of  Team  Leader-Clerical  Assistant  teams  ia  the  resultant 
consistent  preservation  of  clearly  defined  hierarchical    oles  and 
responsibilities.    In  addition,  Team  Leaders  reported  no  deficiencies 
regarding  the  protection  of  respondent  confidentiality.    They  were  able 
to  emphasize  the  importance  of  maintaining  confidentiality  for  all 
respondents,  and  to  set  the  tone  for  their  Clerical  Assistant  by  their 
own  example. 

The  success  of  the  Clerical  Assistant  is  evidenced  also  by 
examinations  of  the  critical  item  edit.    Prom  the  in-house  check  of  the 
critical  item  edit,  it  seen*  th^t  Clerical  Assistants  were  able  to  edit 
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with  acceptable  *  jvels  of  error.    The  rate  of  Type  A  errors—errors 
with  an  implication  for  data  quality—was  1.12  errors  per  case.    On  the 
face  of  it,  an  error  rate  of  more  than  one  per  case  is  high,  but  the 
rate  must  be  assessed  in  the  light  of  the  opportunities  for  error.  For 
every  case  there  were  (  *enty-one  critical  items,  which  means  that  on 
average  the  Clerical  Assistant  made  0.053  errors  for  each  item 
inspected.    Even  this  error  per  item  inspected  statistic  does  not  take 
account  of  the  multiple  opportunities  for  error  within  some  of  the 
critical  items.    For  example,  the  question  that  asks  for  the 
respondent's  name,  address,  and  telephone  number  counts  is  one  item, 
whereas  the  actual  number  of  opportunities  for  error  is  equal  to  the 
number  of  data  elements  under  inspection— namely,  eleven.  Considering 
the  number  of  data  elements  inspected  per  case  (77),  the  Clerical 
Assistant  error  rate  is  0.0145  errors  per  data  element  edited.  Thus, 
it  is  our  assessment  that  the  Clerical  Assistants  were  able  to  conduct 
thn  critical  item  edU  successfully.    The  critical  item  edit  and  the 
m-house  edit  are  discussed  in  further  detail  in  section  3.2. 

2.3.2     Reporting  and  Supervisory  Structure 

Luring  the  field  test,  we  employed  two  different  structures  for 
field  supervision,  in  an  effort  to  determine  the  advantage*  and 
disadvantages  of  each.    Bach  utate  was  staffed  wi     three  to  five  Team 
Leaders  and  Clerical  Assistants  reporting  to  either  a  Field  Manager  or 
a  Central  Office  Supervisor.    The  structures  are  diagrammed  below; 
solid  lines  indicate  supervisory  relationships  and  broken  lin*s 
indicate  consultative  relationships. 


Structure  A 

Central  Office  Field  Management 

Project^  Director 

Associate  Project  Director 

I  N 

•  vv  District  Manager 

Central  Office  %      Field  j 

Supervisory^  NLiaison- ^Divisional  Field  Manager 


»Fielc>  Kanager. 

I 

Team  Leaders 

i 

Clerical  Assistants 
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Structure  B 


Central  Office 


Field  Managemenc 


Project  Director 
Associate  Project  Director 


Central  Office 
Supervisor  -  - 

Tea*  Leader i 

Clerical  Assis  ants 


'^Fieli  Liaison  — —  -  District  ^  Manager 

Divisional  Field  Manager 
--------------  -  Field  Manager 


The  Office  of  Field  Coordination  and  Management  ha;  its  own  structure 
independent  of  the  project.    Structures  A  and  B  vary  in  terns  of  the 
Central  Office  role  in  tie  management  of  the  field. 

Structure  A:    Field  Ma  lager  Primary  Supervisors 

Structure  A,  diagrammed  above,  was  utilized  in  New  York,  Illinois 
and  California.    In  these  states  the  Central  Office  Supervisor  dealt 
almost  exclusively  with  the  Field  Manager,  who  trained  and  assigned 
Team  Leaders,  and  handled  queries  and  took  reports.    Field  Managers 
handled  routine  questions  while  relaying  any  unanticipated  queries  or 
anomalies  to  the  Central  Office  Supervisor  (one  of  three  NBLS:88 
Assistant  Survey  Directors).    These  queries  were  usually  project- 
specific  in  nature;  the  Field  Manager  was  able  to  answer  questions 
concerning  general  field  procedures  and  problems.    In  addition,  .he 
Field  Manager  passed  along  both  individual  (Team  Leader-level  *  d 

jmmary  (state-level)  cost  and  production  information  to  the  Central 
Office  Supervisor.    This  was  an  efficient  and  effective  arrangement, 
because  the  lines  of  conmunication  werfc  clear  and  well-established.  By 
charging  the  Field  Manager  with  the  assignment  el  schools  and  the 
assessment  of  Team  Leader  performance,  the  project  was  able  to  quickly 
redirect  personnel  in  light  of  project  needs  and  Team  Leader 
capabilities. 

Structure  B:    Central  Office  Primary  Supervisor 

In  two  states  (Florida  and  Texas)  structure  B,  also  diagrammed 
above,  was  utilized.    In  these  states  the  Central  Office  Supervisor 
handled  queries  and  took  reports  from  the  Team  Ladders  directly  The 
PieM  Manager  was  responsible  for  assigning  schools  and  training  Team 
Leaders.    This  structure  of  field  supervision  enabled  the  Central 
Office  to  provide  updated  permission  status  reports  to  Team  Leaders 
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immediately  prior  to  Survey  Day.    Similarly,  the  direct  line  to  the 
Central  Office  allowed  for  immediate  clarification  of  any 
misunderstandings  that  might  arise.    Central  Office  Supervisors  were 
able  to  consult  with  a  Field  Manager  concerning  general  field 
procedures  as  needed* 

Conclusion 

The  field  test  suggests  that  either  structure  would  prove  viable 
for  the  bate  year.    Structure  A  calls  for  more  field  control,  and  many 
surveys  at  MORC  use  just  such  a  structure.    Since  Structure  A  results 
in  more  field  control,  a  premium  is  placed  upon  the  development  and 
uffli*ation  of  a  strong  memo  system  to  facilitate  and  document  Central 
Office  and  supervisory  field  staff  communication.    The  advantages  of 
Structure  B  accrue  with  the  need  to  rapidly  respond  to  project-specific 
difficulties  experienced  by  Team  Leaders;  communication  under  such  a 
system  will  rely  more  upon  telephone  contact  between  Central  Office  and 
Team  Leaders.    Both  strictures  were  sufficiently  successful  during  the 
field  test  to  warrant  optimism  regardless  of  which  procedure  is 
selected. 

2.3.3  Adequacy  of  Materia  s  and  Forms 

Three  types  of  forms  were  developed  for  the  field  test;  advance 
written  materials  to  schools,  materials  and  forms  for  fie/d  stiff  ufte, 
and  materials  and  forms  for  central  office  use.    i.  list  of  each  of  the 
forms  ij  provided  (see  List  of  Appendices). 

Advance  written  materials  to  the  schools  were  devised  to  aid  the 
School  Coordinator  in  fulfilling  the  project  .  seds  at  the  school. 
These  forms  will  be  revised  for  the  base  year  on  the  basis  of  School 
Coordinator  de briefings,  and  Team  Leader  and  Central  Office  comments 
and  critiques.    In  addition,  a  School  Coordinator  Manual  will  be 
developed  to  provide  a  central  source  to  which  School  Coordinators  may 
refer. 

We  generated  a  number  of  forms  both  to  assist  Field  Managers  and 
Team  Leaders  in  coordinating  survey  activities  in  the  f eld  and  to 
facilitate  Central  Office  control  over  and  response  to  rield  activity. 
During  the  materials  development  process,  the  Field  Liaison  reviewed 
and  revised  these  materials.    These  forms  wi1!  be  revised  fcr  the  base 
year;  field  staff  feedback  from  all  levels  will  be  considered  during 
this  process,  and  the  Field  Liaison  will  again  play  a  substantial  role 
in  reviewing  materials. 

2.3.4  Mailout  and  Return  Procedures 

As  early  as  five  weeks  prior  to  Survey  Day,  student  packets  were 
mailed  to  the  school  for  distribution  to  curvey  participants.  The 
student  packets  included  a  cover  letter  explaining  NELS:88  and  urging 
student  participation  (see  List  of  Appendices),  a  NELS:88  brochure 
explaining  the  aims  of  the  study,  a  brochure  outlining  the  types  of 
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data  collection  conducted  by  NORC,  and,  when  necessary,  relevant 
content  font  (implicit  or  explicit)  with  instructions  for  filling  them 
out  and  returning  then  to  NORC  or  the  School  Coordinator  as  appropriate 
(tee  Lift  of  Appendices).    It  should  be  noted  that  in  al1  cases 
students  were  instructed  to  give  the  cover  letter  to  their  parents. 
This  letter  outlined  procedures  for  denying  permission  for  their  child 
tc  participate. 

Materials  that  were  used  for  survey  administration  on  Orientation 
Day  and  Survey  Day  were  mailed  to  arrive  at  the  schools  approximately 
two  weeks  prior  to  the  scheduled  dates  of  these  events.  Orientation 
Day  materials  included  a  separate  invitation  to  Orientation  Day  with 
time  and  place  designated,  a  ^8:88  brochure  (same  as  above)  a  NORC 
brochure  (same  as  above),  and  a  student  class  schedule  form  (see  List 
Apper         ).    The  student  class  schedule  form  informed  the  Team 
J  -  thereabouts  of  the  student  on  Survey  Day  should  the 

*«1  to  be  located.    Por  the. most  part,  Survey  Day  materials 
odea  Survey  Day  invitations,  student  questionnaires,  cognitive  tsst 
booklets,  pencils,  time  clocks,  batch  transmittal  forms,  arJ  in  some 
cases  parent  questionnaires.    In  addition,  NORC  miiled  to  the  homes  of 
all  twenty-two  Team  Leaders  enough  extra  supplies  to  covor  one  complete 
Survey  Day  administration  at  both  the  eighth  grade  and  high  school 
level.    These  extra  materials  safeguarded  the  Team  Leaders  against 
misplacement  of  survey  materials  by  school  personnel. 

School  Coordinators  suggested  one  significant  changr.  in  the 
mailing  procedures.    They  suggested  that  NORC  mail  invitational 
materials  under  separate  cover.    Many  School  Coordinators  were  wary  of 
opening  NORC  materials  without  the  presence  of  NORC  personnel.  Thus, 
in  some  cases  students  did  not  receive  the  invitational  matf»~iala  until 
the  day  of  the  event.    This  change  will  most  certainly  be  effected  in 
base-year  mailings. 

After  a  survey  session  was  completed,  Team  Leaders  were  instructed 
to  mail  questionnaires,  test  booklets,  and  completed  batch  transmittal 
forms  to  NORC.    These  materials  were  boxed  at  the  school  and  taken  to 
the  post  office  immediately  after  the  completion  of  the  survey  session. 
In  cases  where  a  Team  Leader  could  not  reach  a  post  office  before 
closing,  she  wa    instructed  to  mail  the  materials  no  later  than  the 
following  morning.    All  materials  were  mailed  First  Class  to  NORC.  Of 
seventy-seven  boxes  of  survey  materials  returned  to  NORC,  seventy-five 
were  safely  received  ard  two  were  lost  in  the  mail. 

2.3.5      Adequacy  of  Survey  Procedures 

Standardized  procedures  were  developed  for  activities  and  contacts 
after  the  conclusion  cf  the  securing  cooperation  phase.    For  purposes 
of  analysis,  these  school  contacts  fall  into  four  different  categories: 
Preliminary  telephone  contacts,  Survey  Day,  Make-up  Day,  and 
Orientation  Day. 
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The  aims  of  each  of  these  contacts  were  quite  specific. 
Preliminary  contacts  with  the  school  served  r«  introduce  the  Team 
Leader  to  the  School  Coordinator  while  providing  an  opportunity  to 
confirm  matters  such  as  date,  time,  and  location  of  Survey  Day 
activities .    These  matters  would  already  have  been  arranged  by  the 
Central  Office.    Survey  Day  itself  would  be  the  primary  visit  of  the 
Team  Leader  for  data  collection.    Make-up  Day  would  provide  an 
opportunity  for  a  second  visit  if  the  Survey  Day  response  rate  was 
insufficient,  i.e.,  below  93  percent  for  eighth-grade  schools,  or  below 
ninety  students  for  high  schools.    Lastly,  Orientation  Days  were 
conducted  in  a  sample  of  twenty  eighth  grade  schools  as  an  experiment. 
Each  of  these  different  types  of  contacts  has  independent  criteria  of 
assessment  based  upon  its  particular  aim. 

Actors  from  many  different  levels  and  publics  were  involved, 
either  as  participants  or  observers,  in  these  activities  and  contacts. 
Consequently,  the  qualitative  assessment  of  procedures  draws  from 
various  sources,  chiefly  School  Coordinators,  Pield  Managers,  Team 
Leaders,  and  Center  for  Education  Statistic*  observers. 

2.3.5.1  Preliminary  School  Contacts:    Outline  and  Assessment 

After  training,  the  Team  Leaders  were  supplied  with  supporting 
materials  for  their  assigned  schools.    Supporting  materials  included 
fact  sheets  providing  relevant  information,  such  as  the  name  and  phone 
number  of  the  School  Coordinator,  the  day,  time,  and  location  of  Survey 
Day,  and  similar  information.    Team  Leaders  were  also  given  scripts  and 
a  schedule  of  calls  to  make  to  the  School  Coordinator.    These  calls 
afBCd       v?rifyinS  the  arrival  of  survey  materials  and  the 
dissemination  of  invitational  materials.    Team  Leaders  were  able  to 
begin  contacting  schools  with  early  Survey  Days  during  January,  shortly 
before  the  field  period  began. 

In  some  cases  the  transition  of  schools  from  Central  Office 
control  to  field  responsibility  did  not  go  entirely  smoothly.  Often, 
these  problems  were  the  result  of  difficulties  encountered  during  the 
school  contacting  phase.    Pot*  example,  some  schools  were  unwilling  or 
unable  to  schedule  a  room  for  Survey  Day  during  the  securing 
cooperation  phase.    Thus,  the  school  would  need  to  be  recontacted  in 
the  early  portion  of  the  field  period,  and  questions  arose  as  to 
responsibility  for  this  interstitial  contact.    In  the  base  year, 
responsibility  will  be  clearly  delineated  throughout  the  securing 
school  cooperation  contact  phase „  which  should  facilitate  the 
transition  of  responsibility  to  the  field. 

2.3.5.2  Survey  Day:  Outline 

Team  Leaders  arrived  at  the  school  approximately  thirty  to  forty- 
five  minutes  prior  to  the  scheduled  commencement  of  Survey  Day 
activities.    They  contacted  the  School  Coordinator,  and  transported 
bulk  materials  stored  at  the  school  to  the  room  scheduled  for  Survey 
Day.    With  the  assistance  of  the  School  Coordinator,  the  Team  Leader 
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gathered  the  sampled  students.    The  Team  Leader  and  Clerical  Assistant 
took  attendance  and  assigned  seating. 

Many  School  Coordinators  introduced  the  Team  Leaders  at  that 
point.    Teas  Leaders  then  read  the  written  script.    The  script  detailed 
some  of  the  purposes  of  the  study,  provided  assurances  of 
conf> Jentiality,  and  informed  participants  of  the  voluntary  nature  of 
the  study.    In  addition,  the  types  of  questions  within  the 
questionnaire  were  discussed.    Team  Leaders  then  handed  out  the  locator 
and  questionnaire  booklets.    Locator  booklets  were  not  used  -    the  high 
school  level. 

During  the  administration  of  the  questionnai? t  materials,  Team 
Leaders  spoke  with  the  School  Coordinator  in  an  effort  to  ascertain  the 
enrollment  status  of  absent  students.    Also  in  the  eighth  grade  school t 
Team  Leaders  used  this  time  to  collect  or  distribute  the  Teacher  and 
School  Qveitionnaires,  depending  upon  whether  or  not  materials  had  been 
distributed  by  the  School  Coordinator.    Respondent  queries  concerning 
items  on  the  student  questionnaire  materials  were  fieldvd  by  the  Team 
Leader,  unless  the  Team  Leader  was  otherwise  occupied  and  felt  that  the 
Clerical  Assistant  was  qualified  to  answer  respondent  queries.    Even  in 
this  circumstance  the  Clerical  Assistant  was  only  allowed  to  re-read 
the  question  and  to  direct  all  unresolved  queries  to  the  Team  Leader. 
For  most  situations  survey  personnel  were  instructed  simply  to  re-read 
the  question  to  the  student;  no  one  was  permitted  to  provide 
interpretations  of  the  questions. 

At  the  conclusion  of  the  survey  administration,  and  with  the 
permission  of  school  authorities,  a  snack  was  provided  for  the 
students.    Afterwards,  the  timed  cognitive  test  battery  was  introduced 
and  administered.    Ouring  the  test  administration,  the  Clerical 
Assistant  conducted  the  critical  item  edit.    The  sheer  quantity  of 
items  typically  needing  retrieval—the  i      ieval  rate  was  on  the  order 
of  one  question  per  case— necessitated  an  adjustment  in  the  plan  for 
retrieval.    (The  retrieval  rate  is  discussed  in  detail  in  section  3.2.) 
During  training  Team  Leaders  had  been  instructed  to  comnence  retrieval 
at  the  conclusion  of  the  test  administration.    But  the  early  completion 
of  the  test  by  some  students  provided  an  opportunity  to  begin  retrieval 
prior  to  the  end  of  the  time  period  allotted  to  the  tests.  The 
critical  item  edit  and  the  retrieval  were  not  conducted  in  the  high 
schools,  where  the  questionnaire  was  included  only  as  a  simulation  of 
testing  conditions. 

At  the  conclusion  of  the  retrieval  process  the  School  Coordinator 
took  responsibility  for  sending  students  back  to  class.    In  designated 
schools  Team  Leaders  distributed  the  Parent  Questionnaire  to  students 
just  prior  to  dismissal.    In  thc*e  cases  students  were  instructed  to 
take  the  Parent  Questionnaire  home  to  the  parent  that  knew  the  most 
about  their  schooling.    The  Team  Leader  and  Clerical  Assistant 
straightened  up  the  room,  counted  and  organized  survey  materials, 
filled  out  the  transmittal  form,  and  determined  whether  or  not  there 
was  a  need  for  a  Hake-up  Day.    Make-up  Days  were  indicated  in  eighth- 
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grade  schools  with  less  than  93  percent  response  rates,  not  counting 
students  that  had  transferred  out  of  the  school,  or  in  high  schools 
with  fewer  than  ninety  students  completing  the  test  battery.    If  there 
was  a  need  for  a  Make-up  Day,  the  School  Coordinator  was  contacted  to 
confirm  the  continued  avaiUbility  of  the  previously  scheduled  Make-up 
Day.    In  the  base  year  the  investigation  of  missing  students  will  also 
entail  determination  of  age,  sex,  and  race  and  ethnicity  information. 

2.3.5.3      Survey  Day:  Assessment 

« 

Generally,  Survey  Days  went  smoothly.    Still,  problems  were 
identified.    Team  Leaders  reported  that  the  scripts  were  too  long, 
basing  their  inferences  on  the  apparent  disinterest  and  impatience  of 
the  students  during  the  presentation.    Scripts  also  provoked  a  number 
of  high  school  students  to  request  permission  to  leave  the  survey 
session;  after  repeated  emphasis  on  the  voluntary  nature  of  their 
participation  they  decided  they  did  not  want  to  take  part  in  the 
survey  • 

Other  than  their  possibly  excessive  length,  the  scripts  were 
sufficient  for  the  eighth  graders.    We  will  shorten  and  tighten  the 
script  for  the  base  year.    According  to  some  observers  from  the  Center 
for  Education  Statistics,,  the  introductory  scripts  seemed  overly 
emphatic  concerning  the  important  issue  of  confidentiality.  Observers 
suggested  that  the  issue  of  confidentiality,  in  addition  to  the  issue 
of  voluntary  participation,  need  be  mentioned  only  once,  rather  than 
three  time*, 

The  snack  was  a  considerable  success  at  the  eighth-grade  level, 
ard  will  be  incorporated  into  the  base  year  procedures.    Team  Leaders 
reported  that  the  students  looked  forward  to  the  snack,  and  that  it  did 
not  cause  appreciable  difficulties  in  maintaining  the  schedule. 


As  noted  above,  the  retrieval  was  begun  during  the  latter  portions 
of  the  test  administration.    According  to  Team  Leader  reports,  the 
retrieval  did  not  disturb  other  students  taking  the  test.    Still,  it  is 
worth  noting  that  in  the  base  year  the  conditions  under  which  the 
retrieval  was  conducted  will  change.    For  example,  revision  of  some  of 
the  high  retrieval  items  may  lower  nonresponse.    More  important  still, 
the  base  year  questionnaire  will  be  shorter.    The  test,  however,  will 
also  be  shorter,  thus  decreasing  the  amount  of  test  time  .available  for 
the  critical  item  edit.    All  of  these  factors  will  need  to  be  weighed 
in  planning  Survey  Day  activities  for  the  base  year. 

In  New  York,  the  inclusion  o*  a  New  York  Stnte  Supplement 
Questionnaire  made  it  more  difficult  to  complete  aU  survey  materials 
in  the  time  allotted.    In  the  base  year,  survey  instruments  will  be 
somewhat  shorter.    Except  for  the  case  of  New  York,  and  the  adjustments 
to  the  retrieval  process,  however,  reports  from  the  field  indicate  that 
sufficient  time  was  allotted  for  each  of  the  instruments  and  tasks  of 
Survey  Day. 

58 


97 


2.3.5.4  Make-up  Day:    Outline  and  Assessment 

Fourteen  Make-up  Days  were  held  in  the  fifty-one  eighth-grade 
schools.    In  six  cases  Team  Leaders  returned  to  conduct  Make-up  Day 
activities ,  following  the  procedures  as  outlined  for  Survey  Day.  The 
remainder  of  the  Make-up  Days  involved  fewer  than  five  students  and 
therefore  were  conducted  by  school  personnel ,    In  these  situations, 
Team  Leaders  instructed  school  personnel  concerning  administration  of 
the  questionnaire  and  cognitive  test  battery,  and  ways  in  which  to 
preserve  respondent  confidentiality.    In  addition,  school  personnel 
were  provided  with  a  postage-paid  return  envelope  to  mail  materials 
back  to  NORC.    To  further  guard  respondent  confidentiality,  the 
critical  item  edit  and  in-school  retrieval  were  not  conducted  in  Make- 
up Day  sessions  administered  by  school  personnel. 

In  two  cases  eighth  grade  School  Coordinators  did  not  conduct 
Make-up  Day  after  agreeing  to  do  so.    In  both  cases  the  school  calendar 
intervened  to  cancel  formerly  scheduled  Make-up  Days.    In  addition, 
often  materials  were  quite  late  in  arriving  from  School  Coordinator- 
conducted  Make-up  Days.    These  delays  were  sometimes  justifiable.  For 
example,  one  School  Coordinator  held  two  Make-up  Days  in  order  to 
administer  the  questionnaire  and  tests  to  a  child  who  had  been  sick. 
This  School  Coordinator  understandably  delayed  mailing  the  first  batch 
of  completed  Make-up  Day  quest  onn&ires  and  tests  to  NORC.    In  other 
cases ,  we  discovered  upon  prompting  them  that  School  Coordinators  had 
forgotten  what  to  do  with  the  material.    This  again  argues  for  the 
development  of  a  School  Coordinator  Manual  to  guide  them  through  all 
activities  in  addition  to  regular  call-back  procedures. 

Fourteen  Make-up  Days  were  held  at  the  high  school  level,  and 
twelve  of  these  required  the  presence  of  the  Team  Leader.    In  two  cases 
the  School  Coordinator  agreed  to  conduct  the  session  for  a  small  number 
of  students  who  missed  the  Survey  Day.    In  either  case,  the  same 
procedures  used  during  Survey  Day  were  followed. 

2.3.5.5  Orientation  Day:    Outline  and  Assessment 

Orientation  Days  were  scheduled  in  a  sample  of  twenty  eighth  grade 
schools,  in  an  effort  to  test  the  effect  of  Orientation  Day  upon 
participation  and  on  administration  of  the  survey.    Orientation  Days 
were  actually  conducted  in  se\ onteen  schools;  three  schools  that  had 
agreed  to  Orientation  Day  were  subsequently  unable  to  schedule  a 
convenient  time.    On  Orientation  Dny  the  Team  Leader  made  a 
presentation  to  the  sampled  students  and  gave  them  an  opportunity  to 
ask  questions  about  the  study.    Students  were  also  requested  to  fill 
out  a  student  schedule  form,  to  facilitate  Team  Leader  follow-up  of 
students  tardy  for  Survey  Day  activities. 

During  the  contacting  yha*ef  five  schools  were  designated  for 
multi-audience  Orientation  Days,  try  which  both  sampled  student's  and 
their  parents  and  teatriei.:  wore  invited.    Of  thsse  five,  ona  school  was 
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never  contacted  because  of  district  refusal ,  one  school  declined  to 
participate  in  any  Orientation  Day,  one  school  refused  a  multi-audience 
event  but  vas  trilling  to  hold  a  students-only  Orientation  Day,  and  the 
two  regaining  schools  agreed  to  multi-auaience  Orientation  Days. 

Field  staff  had  expressed  some  concerns  about  the  challenge  of 
introducing  the  study  to  such  a  heterogeneous  group,  since  the 
disparateness  of  aims  and  levels  ~f  understanding  in  an  assemblage  of 
eighth  graders,  teachers,  and  parents  might  make  it  difficult  to  find  a 
common  level  at  which  to  communicate  with  ind  hold  the  interest  of  all 
parties.    A  further  concern  was  that  such  a  session  might  be  more 
vulnerable  to  disruption  or  mishap,  if,  for  example,  an  atypical  but 
determined  parent,  unhappy  with  government  research  or  with  some 
particular  aspect  of  the  study,  expressed  vociferous  objection  in  the 
presence  of  other  parents,  school  personnel  and  the  students.  The 
effects  of  the  multi-respondent  structure  cannot  be  assessed  from  the 
data  obtained  in  the  field  test,  owing  to  low  parent  and  teacher 
Orientation  Day  participation.    In  fact,  no  invited  parent  attended  the 
two  multi-audience  sessions,  although  one  teacher  did  so. 

Though  their  effect  on  participation  was  only  marginally  positive 
in  most  schools,  Orientation  Days  served  a  number  of  additional 
functions.  Student  schedules  were  collected.    These  proved  helpful 
primarily  for  large  schools  in  which  students  regularly  change  classes. 
The  schedules  were  of  less  value  under  ether  eighth-grade  structures. 
Orientation  Day  provided  Team  Leaders  with  a  valuable  opportunity  to 
learn  about  the  school  environment,  meet  school  personnel  and  reinforce 
the  commitment  of  principals  and  school  coordinators,  review  with  the 
School  Coordinator  the  procedures  for  Survey  Day,  assess  the  adequacy 
of  the  facilities,  and  verify  the  arrival  of  NORC  materials.    Some  Team 
Leaders  felt  that  this  early  exposure  to  the  school  enabled  them  to 
correct  potential  problems  and  therefore  t"  be  better  prepared  for 
Survey  Day.    In  well-organized  schools  adv.  ce  visits  possibly  had  less 
value,  but  in  disorganized  school  environments  they  provided  additional 
information  and  experience  that  could  be  put  to  good  use  in  conducting 
a  successful  Survey  Day. 


In  addition,  some  Team  Leaders  reported  the  reversal  of  some 
permission  denials.    In  one  eighth-grade  school  in  New  York  City 
several  students,  not  wanting  :o  take  part  in  the  study,  "misplaced" 
their  permission  forms.    Consequently  parents  had  not  had  an 
opportunity  to  learn  about  the  study.    On  Orientation  Day  these 
students  were  presented  with  the  reasoning  behind  the  study,  and  all  of 
them  requested  and  were  given  new  permission  forms  to  take  home  to 
their  parents. 

Other  cases  of  converted  permission  denials  occurred,  though  none 
so  dramatic  as  the  New  York  City  example.    This  phenomenon  may  be  a 
result  of  parents  denying  permission  in  an  effort  to  assent  to  their 
child's  relatively  uninformed  desire  to  be  excused  from  participating 
in  the  study.    After  Orientation  Day,  however,  the  student  may  be  more 
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willing  to  take  part  in  the  survey.    It  is  quite  possible  that  the 
student  may  be  able  to  relay  information  to  parents  more  readily  after 
Orientation  Day,  bringing  about  a  reversal  of  the  permission  denial. 
Students  themselves  may  be  more  willing  to  participate  after 
Orientation  Day  because  they  gain  a  better  understanding  of  the 
purposes  of  the  study,  or  because  their  fears  have  been  allayed,  or 
because  of  group  bonding.    Thus,  the  field  test  experience  suggests 
that  Orientation  Days  may  have  special  value  for  explicit  consent 
schools. 


Team  Leaders  indicated  that  many  questions  were  asked  during  the 
orientation  iession.    Questions  centered  upon  whether  or  not  test 
scores  would  be  placed  on  the  students1  record  and  what  students  would 
need  to  do  to  be  excused  from  their  regularly  scheduled  classes.  Some 
Team  Leaders  also  reported  that  students  did  develop  a  sense  of 
camaraderie,  which  might  have  an  impact  on  long-term  participation  in 
future  years. 


The  immediate  effect  of  Orientation  Day  on  response  rates  for 
policy-relevant  populations  and  different  types  of  schools  was  reported 
in  section  2.2.    It  seems  th&e  the  Orientation  Day  is  somewhat 
associated  with  a  decrease  in  Make-up  Days,  as  noted  in  the  Table  2-8. 


This  comparison  of  the  number  of  Make-up  Days  occurring  in  schools 
with  an  Orientation  Day  and  schools  without  an  Orientation  Day  reveals 
that  there  is  a  slight  decrease  in  the  number  of  Make-up  nays  in 
schools  with  an  Orientation  Day. 


Section  2.2,  Indivic  lal  Response  Rates,  discussed  the  effect  ot 
Orientation  Day  f*,r  different  groups  of  students.    It  seems  that  the 
Orientation  Day  evidenced  a  quite  modest  effect  upon  participation 
rates  for  core,  Asian-Pacific  Islander,  and  Hispanic  students.  The 
effect  of  Orientation  Day  did  not  greatly  differ  between  groups— it  had 
approximately  the  same  modest  positive  impact  on  each.  Overall, 
participation  increased  approximately  three  percent  in  Orientation  Day 
schools. 
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TABLE  2-8 


MAKE-UP  DAYS  BY  NO  ORIENTATION  DAY  VS.  ORIENTATION  DAY 


Make-up  Days 
v  Number 

Column  Percent 
Bow  Percent 

No  Make-up  Day 
Number 

Column  Percent 
Row  Percent 


Orientation 
Day 

4 

23.5 
28.6 


13 
76.4 
35.1 


Total 


Number 

Column  Percent 
Row  Percent 


17 
100 


No  Orientation 
Day 

10 
29.4 
71.4 


24 
70.6 
64.9 


34 
100 


Total 


14 


100 


37 


100 


51 


Orientation  Day  effects  on  response  rates  in  different  types  of 
schools  were  also  examined  in  section  2.2.    For  some  types  of  schools 
the  difference  is  negligible.    For  other  types,  Orientation  Day  seems 
to  have  had  a  slightly  negative  effect,  and  for  still  others  the  effect 
seemed  pronounced  and  decidedly  positive. 

For  public  schools,  participation  rates  for  schools  with  an 
Orientation  Day  are  1.3  percent  better  than  participation  rates  for 
schools  without  an  Orientation  Day.    This  difference  i*  negligible. 
For  Catholic  schools  a  decrease  of  5  percent  in  the  response  rates  for 
schools  with  an  Orientation  Day  is  observed.    This  decrease,  however, 
is  based  on  only  two  Catholic  schools  that  had  an  Orientation  Day,  and 
therefore  may  not  be  a  significant  guide  for  base-year  planning.  Given 
that  the  non-Orientation  Day  Catholic  schools  had  99  percent  attendance 
(contrasted  to  a  robust  95  percent  in  the  Orientation  Day  sites)  the 
difference  is  more  likely  to  reflect  the  vagaries  of  local  health 
patterns  on  a  given  day  than  any  characteristic  of  the  orientation 
session. 


For  other  private  schools— a  stratum  of  schools  that  posed  special 
difficulties  at  both  the  securing  school  cooperation  and  obtaining 
parental  permission  stages  of  the  process—the  effect  of  Orientation 
Day  is  more  pronounced.    Other  private  schools  with  an  Orientation  Day 
had  a  participation  rate  15  percentage  points  higher  thin  that  of  other 
private  schools  without  an  Orientation  Day.    Though  again  the  number  of 
schools  involved  is  small,  the  greater  degree  of  the  effect  leads  us  to 
believe  that  this  effect  is  a  reasonably  good  basis  for  base-year 
planning  of  activities  for  other  private  schools. 
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We  noted  above  a  variety  of  functions  the  Orientation  Day 
fulfilled,  iuch  as  facilitating  the  acquisition  of  student  schedules, 
providing  intelligence  about  the  school,  permitting  the  facilities  and 
arrival  of  survey  materials  to  be  checked,  and  enabling  the  Team  Leader 
to  forge  a  stronger  personal  relationship  with  the  School  Coordinator 
and  the  principal.  There  are  additional  functions  that  might  be  served 
by  a  pre-Survey  Day  visit  to  the  school.  Por  example,  Orientation  Dav 
might  be  used  to  facilitate  the  permission  tracking  and  sample  update 
procedures.    Orientation  Day  was  used  in  US&B  to  sample  transfer-ins 
and  effect  substitutions  of  drop-outs  and  deceased  students.  Parent 
questionnaires  might  also  be  distributed  on  Orientation  Day,  to  be 
returned  on  Survey  Day.    In  a  few  cases  during  the  field  tesK,  Team 
Leaders  were  able  to  use  the  Orientation  Day  for  such  purposes,  thereby 
relieving  the  School  Coordinator  of  some  of  the  burden  associated  with 
permission  and  sample  update  procedures. 

Schools  themselves  were  surprisingly  receptive  to  Orientation  Day 
during  contacting.    We  asked  forty-four  of  the  fifty-one  sampled 
schools  contacted  whether  or  not  they  would  be  willing  to  have  an 
Orientation  Day.    Some  schools,  added  at  the  end  of  the  securing 
cooperation  phase  as  time  grew  very  short,  were  not  queried  on  their 
interest  in  having  an  Orientation  Day.    It  was  explained  to  the  School 
Coordinators  that  we  would  draw  a  subsam^le  of  the  willing  schools  for 
Orientation  Day  sessions.    Thirty  schools  (68  percent)  expressed  their 
willingness  to  have  an  Orientation  Day.    Indeed,  we  planned  to  have  an 
Orientation  Day  at  only  twenty  of  the  schools,  and  many  expressed 
disappointment  when  they  were  net  scheduled  for  an  Orientation  Day.  On 
the  other  hand,  gome  schools  that  agreed  to  an  Orientation  Day 
subsequently  found  that  there  was  no  possibility  of  scheduling  it  on 
the  already  crowded  school  calendar. 

Despite  the  possible  advantages  of  Orientation  Day  for  explicit 
consent,  other  private,  and  possibly  certain  hard-to-work  schools,  the 
overall  effect  on  participation  is  small.    Compared  to  the  high  school 
students  case— judging  from  the  evidence  either  of  High  School  and 
Beyond  in  1980  and  1982  or  from  the  NBLS:88  field  test  high  schools- 
eighth  graders  have  such  high  participation  rates  already  that  measures 
such  as  an  orientation  session  can  only  have,  in  general,  l  marginal 
positive  effect.    Nevertheless,  Orientation  Day  can  play  a  considerable 
beneficial  role  in  advance  preparations  for  Survey  Day,  and  we  must 
seriously  consider  whether  its  value  could  be  further  enhanced  by 
folding  additional  pre-survey  activities  into  this  initial  school 
visit • 

2.3.6      Data  Receipt  and  Processing  -  Student  Questionnaire 

The  Team  Leaders  were  instructed  to  mail  the  completed 
questionnaires  and  tests  to  NORC  after  they  had  completed  the  survey  at 
a  school.    In  fact  many  Team  Leaders  took  the  boxes  home  to  finish 
tallying  and  packing  the  box  more  securely  for  mailing. 
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Upon  delivery  of  the  box  to  NORC  the  receipt  controL  clerk 
reconciled  the  enclosed  questionnaires  and  tests  with  the  transmittal 
form  filled  out  by  the  team  L    der  to  make  sure  no  discrepancies 
existed  between  what  was  thought  to  be  sent  and  what  had  been  received. 

The  tests,  and  one  copy  of  the  transmittal  form  were  put  aside  for 
future  shipment  to  ETS.    The  questionnaires  were  given  to  the  in-house 
edit  clerk  for  a  final  edit  after  which  they  were  sent  on  to  data 
entry.    (On  the  in-house  edit,  see  Section  3.2  Student  Questionnaire 
Data:    Analysis  and  Proposed  Item  Revisions.)    Owing  to  their 
restricted  numbers,  field  test  questionnaires  were  keypunched  although 
the  base  year  student  questionnaire  (minus  the  locator  section)  will  be 
optically  scanned.    Key  locator  data  were  edited  for  possible  future 

Data  from  the  main  questionnaire  were  not  cleaned — that  is, 
machine  editing  progr**as  were  not  employed— since  doing  so  would  have 
lessened  their  value  for  purposes  of  the  nonresponse  analysis. 

The  receipt  control  clerk  updated  the  survey  management  system 
(SMS)  entering  the  current  student  status  disposition  from  a  copy  of 
the  completed  transmittal  form.    (For  a  complete  description  of  the  SMS 
please  see  Chapter  4.)    The  clerk  also  updated  the  school  receipt 
control  database  entering  the  following  information: 

~  date  the  box  was  received 

-  number  of  completed  questionnaires 

-  number  of  completed  tests 

-  date  questionnaires  were  sent  to  data  entry 

-  date  tests  were  sent  to  ETS 

-  make-up  dace,  if  one  was  scheduled 

Generally,  the  mail  process  ran  smoothly.    We  did  notice  in  a  few 
instances  that  boxes  took  longer  to  arrive  from  the  field  than 
expected.    These  exceptional  cases  turned  out  not  to  b3,  as  expected, 
explicitly  stamped  first  class  mail,  although  they  were  mailed  under  a 
first  class  postal  permit.    Team  Leaders  were  reminded  to  either  nark 
the  box  "first  class"  or  make  sure  the  postal  clerk  did  so.    For  the 
base  year,  if  the  U.S.  Postal  Service  is  used,  we  will  mark  the  boxes 
here  at  NORC  before  m  terials  are  mailed  to  the  field. 

Two  boxes  were  lost  in  the  mail  and  never  arrived  at  NORC.  The 
U.S.  Post  Office  requires  a  wait  of  30  days  before  initiating  a  search 
on  a  box.    Both  Team  Leaders  have  initiated  the  search  procedure,  but 
to  date  (May  28,  1987)  the  missing  boxes  have  not  been  traced.    The  2 
boxes  represents  a  loss  cf  2.6  percent  of  our  materials.    We  are  also 
investigating  the  cost  and  reliability  of  private  mail  companies  for 
use  in  tue  base  year.    A  matter  that  should  be  considered  is  what 
incentives  could  be  offered  to  a  school  whose  materials  were  lost,  to 
enlist  its  cooperation  in  efforts  to  survey  them  a  second  time. 
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2.3.7     Cone lus ions  and  Recommendations 


Although  the  task  of  securing  district  and  school  persuasion  was 
often  arduous,  once  an  eighth-grade  school  had  agreed  to  cooperate, 
survey  procedures  could  be  smoothly  implemented.    Indeed,  eighth  grade 
proved  to  be  an  even  more  hospitable  survey  environment  in  the  field 
test  than  high  schools.    School  staff  were  generally  more  cooperative 
sn*  exercised  far  tighter  control  of  the  student  population  than  did 
the  staff  of  secondary  schools,  and  students  themselves  were 
enthusiastic  about  the  study.    The  result  was  a  high  initial  in-school 
participation  rate  for  all  schools  in  which  parental  consent  had  been 
generally  obtairable. 

Given  the  favorable  environment  for  student  participation, 
Orientation  Days  boosted  response  far  less  dramatically  than  might  have 
keen  the  case  in  a  less  favorable  environment.  Nevertheless,  in  certain 
types  of  schools,  more  at  risk  for  low  levels  of  participation,  the 
orientation  sessions  proved  of  value,  both  in  fostering  return  of 
explicit  permission  forms  and  in  increasing  attendance  on  Survey  Day. 
In  addition,  the  Orientation  Days  seemed  to  fulfill  a  number  of 
additional  functions,  and  further  activities  (for  example,  conducting 
the  sample  update  on-site)  could  be  efficiently  folded  into  Orientation 
Days.    While  we  think  that  much  benefit  can  come  from  a  pre-survey 
school  visit,  it  must  also  be  said  that  generally  survey  sessions  went 
very  well  in  the  field  test  even  at  schools  with  no  Orientation  Day, 
and  that  the  resources  spent  in  such  a  visit  must  be  judiciourly 
weighed  against  the  benefits  that  would  accrue  from  alternative 
investments,  such  as  in-person  or  additional  at-home  training  of  Team 
Leaders. 

Purvey  Days  generally  moved  smoothly,  as  did  M&ke-up  Days 
conducted  by  Team  Leaders.    Survey  Day  scripts,  however,  should  be 
shortened.  It  is  clear  that  more  explicit  written  instructions,  and 
systematic  prompting,  will  be  necessary  to  ensure  that  small  make-up 
sessions  left  in  the  hands  of  School  Coordi  istors  are  successfully 
conducted  in  the  base  year.    While  survey  forms  facilitated  cl^ar 
transmittal  records,  the  2.6  percent  rate  of  loss  in  transit  (or 
completed  tests  and  questionnaires  shipped  via  U.S.  First  Class  Mail) 
is  troubling  end  suggests  the  need  to  investigate  prospects  for  finding 
more  secure  means  to  transmit  materials. 
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CHAPTER  3:    ANALYSIS  OP  STUDENT  SURVEY  RESULTS 


ERIC 


3.0  Overview 

In  Chapter  3,  we  analyze  the  principal  field  test  results  and 
propose  modifications  in  the  survey  instruments.    Every  effort  will  be 
made  to  iteratively  pre-test  textual  mc  ifications  in  questionnaire 
items  with  small  groups  of  students. 

In  3.1,  we  address  two  sampling  issues.    First,  we  evaluate  the 

Laraple  updating  procedure.  Then  we  compare  student  ethnic  self-reports 

with  school  reports  (roster  annotations  as  to  Hispanic  or  Asian-Pacific 
Islander  ethnicity). 

In  3.2,  we  analyze  the  student  questionnaire  data.    We  do  so  from 
seven  perspectives.    First,  we  examine  the  results  of  the  in-house 
critical  item  edit,  both  to  appraise  the  success  of  retrieval  efforts, 
and  also  to  evaluate  the  quality  of  the  in-school  edit  conducted  by  the 
Clerical  Assistant.    Second,  we  define  and  :iet  limits  for  item 
nonresponse,  and  analyze  each  problematic  data  element  in  the  student 
questionnaire.  We  attempt  both  to  identify  the  causes  of  nonresponse, 
and  to  address  nonresponse  problems  through  suggestions  for  improved 
item  wording,  Questionnaire  formatting,  or  survey  procedures.  Third, 
we  systematically  address  logical  consistency  issues  by  examining 
inter- item  consistency  and  consistency  of  response^  to  filter  and 
dependent  questions.    Fourth,  we  appraise  questionnaire  length  by 
cornering  the  quality  of  responses  in  early  items  with  the  terminal 
items  in  the  student  instrument.      Fifth,  we  compare  student  and  parent 
reports,  where  parallel  d£«:a  have  been  solicited.    Here  we  give 
particular  emphasis  to  the  cross-validation  of  SES  data.     Sixth,  we 
examine  the  reliability  of  the  two  attitude  scales—locus  of  control 
and  self-estoem—that  appear  on  the  student  questionnaire.    Finally,  we 
investigate  whether  high  nonresponse  items  of  a  particular  type  pose 
more  of  a  problem  for  one  particular  population  of  respondents  than 
another  (for  example,  students  with  low  grades,  students  from  different 
socioeconomic  backgrounds). 

The  concluding  section  of  Chapter  3  (3.3)  is  an  analysis  of 
cognitive  test  battery  results. 

3.1      Student  Sampling  Data 

3.1.1      Updating  the  Sample 

In  order  to  give  each  eighth  grade  student  equal  probability  for 
selection  into  the  sample,  school  coordinators  were  asked  to  compile  a 
list  of  all  eighth  graders  who  transferred  in  between  the  time  student 
rosters  were  produced  and  Survey  Day.    Approximately  10  days  prior  to 
Survey  Day  school  coordinators  supplied  NORC  with  a  list  of  students 
who  qualified  as  transferred-in.     School  coordinators  coded  these  lists 
for  ethnicity  and  eligibility  just  as  they  had  done  earlier  for  the 
eighth  grade  student  roster.    Also  at  this  time,  school  coordinators 
identified  previously  sampled  students  who  had  transferred  out  or  who 
had  become  ineligible  because  of  a  permission  denial  from  the  parent  or 
guardian.    All  of  this  information  was  recorded  on  the  Sample  Update 
Form  (see  List  of  Appendices). 
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Sample  updating  was  conducted  by  central  office  staff  in  the  first 
four  weeks  of  the  field  period.    Based  on  the  central  office 
experience,  specifications  were  written  for  field  staff,  and  the 
updating  function  transferred  to  Team  Leaders.    Field  personnel  proved 
able  to  follow  che  updating  instructions  and  to  implement  the  procedure 
successfully. 

Under  these  procedures,  transfer-in  students  were  sequentially 
numbered  and  selected  for  inclusion  in  the  sample  based  on  the  same  set 
of  computer  generated  random  numbers  used  to  select  the  original  sample 
of  32  students.  r 

Information  from  the  Sample  Update  Forms  indicates  chat  across  the 
51  field  test  schools  there  were  115  transfer-ins,  of  whom  11  were 
selected  for  inclusion  into  the  sample.    While  no  records  were  kept  for 
the  total  number  of  transfer-outs  per  school,  our  receipt  control 
system  indicates  that  65  of  the  1,531  sampled  students  transferred  out 
prior  to  Survey  Day. 

The  sample  update  procedure  had  assumed  a  rough  symmetry,  for  the 
sample  as  a  whole,  regarding  the  number  of  transfer-ins  and  transfer- 
outs,  and  sample  gains  and  losses  from  transfers,    *he  ratio  of  11  to 
65  contradicted  this  assumption  dramatically. 

Two  factors  probably  explain  most  of  this  asymnetry.    In  some 
cases  we  found  that  original  rosters  had  not  been  sufficiently 
reviewed  and  that  selected  students  had  in  fact  transferred  out  many 
days  or  weeks  prior  to  the  drawing  of  the  sample.    An  additional,  and 
probably  more  important  factor,  was  that  many  schools  did  not  have 
ready  records  of  the  transfer-ins.    This  was  particularly  true  of 
schools  with  computerized  record-keeping  systems,  which  often  had 
rosters  that  were  up-to-date  to  the  very  day,  but  no  record  of  the  date 
on  which  a  new  student  had  been  added.    In  such  cases  school 
coordinators  had  to  reproduce  entire  eighth  grade  rosters  and  compare 
them  to  an  earlier  version  of  the  same  roster  in  order  to  identify 
transfer-in  students.    In  all  probability  it  was  the  added 
administrative  burden  of  compiling  a  list  upon  request  that  caused  the 
under-reporting  of  transfer-ins,  coupled  with  the  error  that  may  attend 
manual  cross-checking  of  lengthy  lists.    To  forestall  this  problem  for 
in  base  year  of  NClS:88,  one  solution  would  be  to  provide  school 
coordinators  with  specifications  for  keeping  a  cumulative  list  of 
tranafer-in  students  as  part  of  the  procedure  for  producing  student 
rosters  for  the  entire  eighth  grade  class.    School  Coordinators  were 
asked  a  number  of  ti-nes  whether,  should  they  be  asked  to  keep  a  log  of 
transfers  from  the  minute  the  initial  sample  list  was  generated,  they 
could  readily  do  so.    Coordinators  felt  that  they  could  indeed  do  this, 
and  that  doing  so  would  produce  accurate  lists  of  their  new  students. 

3.1.2      Identification  of  OB EN LA  Sample 

One  question  of  special  interest  in  the  field  test  was  how 
successful  schools  would  be  in  identifying  members  of  the  two  groups 
(Hispanics,  Asians-Pacific  Islanders)  that  would  be  specially  sampled 
for  the  OBEMLA  supplements.    Crosstabulation  of  student  ethnic  self- 
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report  with  the  school's  report  provides  a  means  of  judging  how  well 
schools,  under  the  field  test  conditions,  could  identify  Hispanics  and 
Asians.    For  ethnic  annotation  purposes,  schools  were  asked  to  consider 
a  student  to  be  Hispanic  if  by  self-report,  by  native  language,  or  by 
ethnicity  or  national  origin,  he  or  she  was  Hispanic  or  Latino— that 
is,  had  predominant  origins  (at  least  fifty  percent)  in  any  of  the 
traditionally  Spanish-speaking  countries  of  North,  Central,  o.-  South 
America.    Similarly,  schools  were  asked  to  consider  a  student  to  be 
Asian-Pacific  Islander  if  by  self-report,  by  native  language,  or  by 
ethnic  onpin,  predominant  origins  (at  least  50  percent)  included  the 
Asian  countries  of  the  Pacific  Basin  (for  example,  China,  Japan, 
Southeast  Asia,  the  Philippines,  and  the  islands  cf  the  Pacific). 
Since  emphasis  was  on  the  original  peoples  of  the  Orient  and  Pacific 
islands,  natives  of  Asian  countries  outside  the  Pacific  Basin,  such  as 
India,  Pakistan,  Soviet  Asia,  and  so  on,  were  not  to  be  included. 

School  ethnic  report  in  the  field  test  might  come  from  any  of 
several  sources.    In  small  schools,  a  School  Coordinator  would  normally 
know  most  if  not  all  students  by  sight  and  name.    In  these  settings, 
coordinators  were  usually  reasonably  sure  of  whether  any  given  student 
was  or  was  not  Hispanic  or  an  Asian/Pacific  Islander.    In  larger 
schools,  the  coordinator  would  know  only  a  small  proportion  of 
students,  but  sometimes  could  rely  on  school  records  for  clarification 
of  the  ethnicity  of  other  students.  To  the  extent  thac  ethnicity 
records  were  on  file,  their  accuracy  is  uncertain.  In  most  cases, 
however,  we  were  told  that  the  school  drew  its  ethnic  categories 
differently—so  that  they  were  not  co-extensive  with  the  two  OBEMLA 
groups — or  had  no  listings  by  ethnicity. 

In  New  York  City,  for  example,  records  reflect  students  who  speak 
English  in  the  home,  students  uho  speak  Spanish  in  the  home,  and 
students  whose  home  language  is  other  than  English  or  Spanish.  Since 
Spanish  mother-tongue  and  Hispanic  ethnicity  are  not  conterminous,  and 
since  non-English  or  non-Spanish  is  not  equivalent  to  Asian-Pacific 
Islander,  ?uch  records  are  of  limited  value  in  annotating  ethnicity. 
While  schools  generally  have  lints  of  Limite.  English  Proficiency 
students,  these  too  are  of  restricted  value  in  identifying  ethnically 
Hispanic  and  Asian  populations.    Many  districts  indicated  that  it  was  a 
matter  of  strict  policy  that  schools  not  categorize  students  by  their 
ethnic  origins  or  keep  records  with  this  information. 

In  caaes  where  limited  or  no  ethnicity  records  were  available, 
the  School  Coordinator  reviewed  the  eighth  grade  roster,  looking  for 
names  of  students  he  or  she  knew,  looking  for  Spanish  surnames,  and 
looking  for  obviously  Asian  names,  and  using  as  an  additional  resource 
any  records  that  might  identify  some  part  of  the  relavant  populations. 
Sometimes  School  Coordinators  did  further  checking  with  homeroom 
teachers.  This  was  at  the  Coordinator's  initiative;  NORC  had  not  ^uilt 
a  teacher  check  into  the  specifications  for  preparing  the  roster."  In 
exceptionally  large  schools  with  many  homerooms,  teacher  review  of 
student  rosters  would  not  have  been  convenient  for  the  coordinator,  and 
deadlines  for  processing  rosters  limited  the  amount  of  time  that  could 
be  devoted  to  cross-checking  student  lists.  Nevertheless,  where 
teachers  were  extensively  consulted,  they  were  able  to  contribute 
substantially  to  the  identification  of  targeted  minority  language 
populations.    Given  the  school  record  and  personnel  resources  available 

O  68 

ERIC  107 


for  use  in  identifying  Hispanic  and  Asian-Pacific  American  students, 
some  degree  of  inaccuracy-- especially  undercounting— could  be  expected 
in  the  ethnicity  annotations.    Whether  such  inaccuracy  was  within  a 
tolerable  range  could  not  be  foreseen  and  one  of  the  purposes  of  the 
field  test  was  to  investigate  this  issue. 

In  Table  3-1,  school  and  student  ethnicity  reports  are  compared  by 
crosstabulating  student  questionnaire  item  1  (AREA  OF  WORLD  ANCESTORS 
LIVED  BEFORE  COMING  TO  AMERICA)  with  ethnicity  (Hispanic,  Asian-Pacific 
Islander,  Other  (»  neither  Hispanic  nor  Pacific  Islander)  taken  from 
the  annotated  eighth-grade  roster. 

TABLE  3-1 

CROf "TABULATION  OF  SCHOOL  ETHNICITY 
REPORT  WITH  STUDENT  ETHNICITY  REPORT 
(HISPANIC,  ASIAN-PACIFIC,  CORE) 


SCHOOL 
REPORT—> 

STUDENT 
REPORT 

I 


HIS 


API 


CORE 


TOTAL 


HIS 

176 

5 

76 

257 

API 

5 

90 

71 

166 

CORE 

3 

1 

823 

827 

DK 

1 

0 

4f 

47 

Total 


180 


91 


1016 


1297 


Apparently,  schools  reported  only  68  percent  of  those  who  were  by 
self-report  Hispanic,  and  54  percent  of  those  who  reported  themselves 
to  be  Asian-Pacific  Islander.      If  self-reporis  of  ethnicity  are  to  be 
regardad  as  more  reliable  than  school-reports  (this  assumption  will  be 
further  discussed  below),  then  under-reporting  of  the  two  OBEMLA- 
supplemental  groups  appears  to  be  seriously  large.    On  the  other  hand, 
over-reporting  of  these  groups  appears  to  be  extremely  small: 
approximately  one  half  of  one  percent  of  self-identified  core  students 
(4)  were  characterized  as  Hispanic  (1)  or  Asian  (3)  by  their  schools. 

These  conclusions  are  sowewhat  qualified  when  the  crosstabulation 
is  extended  to  API  and  Hispanic  subgroups.    For  Hispanics,  all  groups 
were  under-identified  by  schools,  though  this  was  least  so  for  Cubans. 
(This  fact  may  reflect  administrators'  especially  close  knowledge  of 
students  in  the  two  small  private  schools  in  Miami  from  which  most  of 
the  sampled  Cubans  come.)    Undfv-identif ication  was  a  problem  for 
Mexican-Americans  (29  of  i20  or  24  percent  under-identified),  who  were 
concentrated  in  several  California  and  Texas  schools?  for  P»erto  Ricans 
(11  of  25  or  44  pv  cent  of  self-identified  Puerto  Ricans  were 


69 

108 


identified  as  Hispanic  on  school  rosters),  who  were  roost  heavily 
represented  in  Mew  York  schools;  and  was  also  a  problem  for  the  Other 
hxspanics  OS  of  58  or  45  percent  identifi<  d  as  Hispanic  on  the  school 
rost  r)  who  appeared  in  a  variety  of  schools,  especially  in  New  York, 
Florida  and  California.    Thus,  under-identif ication  would  appear  to  be 
pervasive,  a  problem  that  occurred  in  a  wide  range  of  schools  in  every 
site  where  Hispanics  were  substantially  represented. 

TABLE  3-2 

CROSSTABULATION  OF  HISPANIC  SUBGROUP 
MEMBERSHIP  ( STUDENT  REPORT)  WITH  ETHNICITY  (SCHOOL  REPORT) 


SCHOOL 
REPORT~-> 

STUDENT 

REPORT 

1 

HIS 

A^I 

CORE 

TOTAL 

1  MEXICAN 
1 

91 

0 

29 

120 

CUBAN 

48 

1 

5 

54 

PUERTO  RICAN 

11 

0 

14 

25 

OTHER  HISPANIC 

26 

4 

28 

58 

Total 

176 

5 

76 

257 

Our  experience  in  iterative  pretesting  showed  that  there  could  be  some 
lavel  of  student  error  in  use  of  the  ethnic  categorizations  of      Q.l  and 
that  a  student  who  did  not  understand  what  was  mear*.  by  "Hispanic"  or 
"Asian-Pacific  Islander"  would  work  through  the  list  of  subgroups,  find 
none  that  corresponded  to  hU  or  her  own  ethnic  identity,  and  opt  for  the 
last  elemert,  "Other,"    Thus  *hi1e  the  presumption  is  that  self-report  will 
be  more  reliable  for  ethnic  cate^  >ri .^tion  than  school-report,  some  amount 
of  student  error  is  also  expected,  primarily  in  the  "Other"  category.  We 
therefcre  looked  at  "Other  Hispanic,"  which  asks  the  respondent  to  wiite  in 
the  group  to  which  he  belongs.    Of  the  58  self-  eported  Other  Hispanic 
cases,  26  are  recoraed  as  Hispanic  by  the  school  and  32  are  not.  However, 
of  these  32,  fully  19  are  probable  student  errors  of  self-classification. 
These  cases  (thrt  is,  in  15  instances)  mostly  fall  into  various  European 
groups  such  as  Italian,  Portuguese,  Irish,  German  and  English— although 
Spain  is  the  largest  such  group  (seven  instances).    Note  that  the  question 
asks  about  the  area  of  the  world  the  respondent's  ancestors  lived  in  before 
coming  to  "America,"  not  "the  United  States."      It  is  therefore  uncertain 
that  these  European-origin  students  are  in  all  cases  mistaken  in  reporting 
themselves  *3  Hispanic.    Many  countries  in  Latin  America  have  large 
populations  of  European  descent  and  it  is  quite  possible  to  be,  for 
example,  a  Spanish-speaking  ethnic  Italian  from  Argentina— but  the  numbers 
suggest  that  many  if  not  most  or  all  of  these  students  have  opted  for  an 
incorrect  categorization.    Another  block  of  probably  incorrect  responses 
comes  from  non-Spanish  speaking  portions  of  the  West  Indies  (two  Haiti,  one 
Trinidad).    The  majority  of  the  responses  under  Other  Hispanic  are, 
however,  from  South  or  Central  America,  with  Co1  ~>bia  (6)  and  El  Salvador 
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(5)  the  most  common — but  Bolivia,  Guatemala,  Ecuador,  Argentina,  Chile, 
Paraguay,  and  Peru  are  alto  represented.    In  one  case,  a  student  who  was 
half  Mexican  and  half  Spanish  represented  himself  as  Other  Hispanic.    If  we 
adjust  for  the  probable  level  of  student  error  in  the  Other  Hispanic 
category,  Hispanic  ethnicity  as  reported  by  the  school  should  prove 
somewhat  more  accurate  than  suggested  by  the  initial  crosstabulation.  The 
31  seemingly  miscategorized  Other  Hispanics  may  in  fact,  be  as  few  as  13. 
But  the  level  of  error  over  the  four  Hispanic  categories  still  stands  at 
about  one  fourth  of  the  total. 

When  subgroups  are  brought  into  the  crosstabulation  for  Asian- 
Pacific  Americans,  the  results  qualify  the  broader  picture  importantly. 
This  crosstabulation  shows  that  disagreement  between  school-  and 
student-report  is  concentrated  in  the  category  Other  Asian,  where  only 
18.4  percent  of  those  who  are  Other  Asian  by  self  report  are 
characterized  as  of  Asian  ethnicity  by  the  school.    However,  there  are 
two  other  categories  which,  though  smaller  in  absolute  numbers,  we 
presume  have  a  similarly  high  proportion  of  students  who  are 
misclassif ied  by  their  schools.    Annotated  rosters  also  show  as  Asian 
only  45  percent  of  those  who  claimed  to  be  of  Japanese  descent  and  only 
36  percent  of  those  who  maintained  they  were  Pacific  Islanders.  Other 
groups  were  more  successfully  identified:    school-  and  self-reports 
agrte  for  82  percent  of  Chinese,  75  percent  of  Pil:pinos , %91  percent  of 
Koreans,  and  70  percent  of  Southeast  Asians. 

TABLE  3-3 

CROSSTABULATION  OP  ASIAN-PACIFIC  SUBGROUP 
MEMBERSHIP  (STUDENT  REPORT)  BY  ETHNICITY  (SCHOOL  REPORT) 


SCHOOL 
REPORT— > 

STUDENT 
REPORT 
I 
I 
I 


HIS 


API 


CORE 


TOTAL 


CHINESE 

1 

23 

4 

28 

PILIPINO 

1 

24 

7 

32 

JAPANESE 

1 

5 

5 

11 

KOREAN 

0 

10 

1 

11 

SOUTHEAST  ASIAN 

J. 

14 

5 

20 

PACIFIC  ISLANDER 

0 

5 

10 

15 

OTHER  ASIAN 

1 

9 

39 

49 

TOTAL 

5 

90 

71 

166 

It  is  difficult  to  give  a  more  than  speculative  explanation  for 
some  of  these  differences.    Whether  the  large  misidentif ication  of 
Japanese  reflects  their  degree  of  assimilation  and  lack  of 
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concentration  in  the  U.S.  population,  or,  is  simply  an  artifact  of 
small  numbers  in  a  small  field  test  sample  is  uncertain.  Since 
Southeast  Asian  names  are  usually  highly  recognizable—while  Chinese 
surnames  when  combined  with  European  first  names  (for  example,  "Jason 
Lee1*)  sometimes  produce  ambiguity— one  might  expect  more  under- 
reporting of  Chinese  although  in  fact  Southeast  Asians  appear  as 
slightly  norc  under-reported.    While  Chinese  (especially  south-Chinese) 
are  a  relatively  clustered  population  that  may  have  special  visibility 
and  program  significance  within  a  school,  this  is  generally  at  least  as 
true  of  recent  immigrants  from  southeast  Asia.    We  had  expected 
Pilipinos,  with  their  Spanish  names,  to  be  often  misreported  by  schools 
as  Hispanic.      This  in  fact  happened  only  in  one  case  for  the  thirty- 
one  self-reported  Pilipinos.      However,  a  number  of  Hispanics  were 
reported  as  Asians,  and  it  may  be  that  some  of  these  Spanish-surname 
students  were  assumed  by  schools  to  be  Filipino.  (It  is  also  possible 
that  these  cases  represent  clerical  errors  in  annotation.)    Since  many 
Guamanians  and  other  Pacific  Islanders  have  taken  western  names,  it  is 
perhaps  uot  surprising  that  in  large 'schools  some  of  these  students 
might  be  missed. 

The  Other  Asian  category,  with  more  apparent  misclassif ications 
(39)  than  all  the  other  Asian  subgroups  combined,  and  with  the  greater 
likelihood  of  error  that  attends  a  catch-all  category,  was  reviewed  in 
the  hard-copy  questionnaires.    A  list  was  compiled  from  the  write-in 
portion  of  the  question. 

Of  the  49  responses,  24  are  clearly  in  error:    Italy  (4),  Africa 
(3),  Poland  (2),  England  (2),  Ireland  (2),  Germany  (3),  Sweden  (1), 
Hungary  (1),  Yugoslavia  (1),  Holland  (1),  Czechoslovakia  (1),  Florida 
(1),  White  (1),  Caucasian  (1).    Two  more    Russia)  are  probable  errors — 
possibly  the  respondent  meant  to  cite  origin  in  the  Asian  portions  of 
the  Soviet  Union,  but  since  the  United  States  has  received  few 
immigrants  from  Soviet  Asia  these  responses  seem  more  likely  to  be 
errors.    If  so,  26  or  well  over  half  of  the  student  reports  are  likoly 
to  be  in  er. or. 

In  a  large  number  of  the  remaining  instances,  student  and  school 
reports  disagree,  but  because  the  OBEMLA  Asian-Pacific  Islander  group 
is  not  coextensive  with  all  Asians,  this  disagreement  does  not  mean 
that  either  the  school  or  the  respondent  made  an  incorrect  ethnic 
attribution.     Thus  13  are  south  Asians,  from  the  Indian  subcontinent 
(they  describe  themselves  as  Indian,  Hindu,  Bengali  or  Pakistani). 
Another  five  are  Asian  Arabs  from  such  countries  as  Syria,  Jordan  or 
Lebanon.    One  respondent  is  Armenian.    All  of  these  groups  are  clearly 
Asian,  but  do  not  fall  into  the  Asian-Pacific  Islander  supplement,  with 
its  Pacific  Basin  focus. 

Finally,  there  is  a  small  group  that  is  both  Asian  and  correctly  a 
part  of  the  OBEMLA  supplement — one  Taiwanese,  one  Thai — and  though 
there  was  a  separate  Southeast  Asian  category  provided  for  them,  with 
Vietnamese  given  as  an  example — two  Vietnamese. 

If  only  four  of  the  49  Other  Asians  are  properly  OBEMLA 
supplementary  students,  the  schools,  rather  than  undercounting  by  39, 
overcounted  by  four.    If  we  assume  that  self-reports  for  Chinese, 
Filipino,  Japanese,  Korean,  Southeast  Asian  and  Pacific  Islander  are 
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likely  to  be  accurate,  the  schools  undercounted  30  times  an.  assigned 
members  of  these  groups  to  the  wrong  supplement  (possibly  a  clerical 
error)  four  tines  for  an  undercount  rate  of  approximately  34/114  or 
nearly  30  percent,  or  slightly  higher  than  the  school  undercount  of 
Hispanic*. 

As  a  further  check  on  student  reports,  we  crosstabulated  student's 
self-reported  ethnicity  with  parent  ethnicity,  when  this  information 
was  available.    (Since  not  all  schools  had  the  parent  survey  and  not 
all  parents  participated,  there  were  paren ;  reports  for  only  about 
fifty-four  percent  of  the  students.)    We  determined  whether  parent  and 
student  agreed  on  the  same  broad  category—Asian-Pacif ic ,  Hispanic,  or 
Core.    Of  course,  since  some  students  have  a  dual  heritage  and  may 
identify  ethnically  with  a  parent  other  than  the  one  completing  the 
questionnaire,  a  discrepancy  between  parent  and  student  ethnicity  need 
not  be  contradictory.    Nevertheless,  the  correlation  between  the  two 
should  be  extremely  high. 

There  was  high  correspondence  between  Hispanic  student  and  parent 
reports  (93  percent)  with  raor  :  of  the  error  in  the  Other  Hispanic 
category.    There  was  reasonably  high  correspondence  between  parent  and 
student  reports  of  Asian  ethnicity  (88  percent),  when  the  Other  Asians 
were  excluded,  but  the  high  rate  of  error  (only  10  of  27  reports 
matched)  in  Other  Asian  brought  the  overall  percentage  down  to  72 
percent.    The  other  category  that  was  plagued  with  error  was  Pacific 
Islander,  where  there  were  only  two  matches  out  of  six.    If  we  consider 
only  Filipinos,  Chinese,  Japanese,  Koreans  and  Southeast  Asians, 
parent-student  reports  matched  94.3  percent  of  the  time.    The  parent 
reports  confirm  the  main  conclusions  reached  above—there  is  much  error 
(student  over-reporting)  in  the  Other  Hispanic  and  Other  Asian 
categories;  schools  nevertheless  substantially  undercounted  the  main 
Hispanic  and  Asian  groups.    Ho  rever,  schools  may  not  have  substantially 
undercounted  Pacific  Islanders,  since  parent  reports  often  fail  to 
corroborate  student  reports  for  this  small  group. 

Of  course,  complete  accuracy  in  school  reports  is  not  required. 
Inaccurate  rsports  at  the  school  level  are  over-ridden  by  student  self- 
reports,  insofar  as  roster  ethnicity  is  solicited  only  as  a  sampling 
datum.    Should  large  numbers  of  students  be  misidentif ied  as  Hispanic 
or  Asian-Pacific,  the  selection  procedures  would  risk  not  bringing 
enough  supplementary  students  into  the  sample.    We  see  evidence  of  only 
a  small  amount  of  over-reporting  of  these  groups.    While  under- 
reporting is  less  serious  a  difficulty,  sampling  efficiency  will  be 
maximizes  if  further  efforts  can  be  made  to  increase  the  accuracy  of 
roster  annotations.  There  is  some  risk  of  sample  bias  if  certain  types 
of  supplementary  sample  students  are  more  likely  to  be  underidentif ied 
than  others.    It  is  not  unlikely  that  recent  immigrants,  who  are 
somewhat  more  concentrated  and  more  likely  to  experience  language 
difficulties  and  receive  special  educational  assistance,  will  be  less 
often  missed  than  more  assimilated  students.    If  so,  school 
identification  of  the  more  policy-relevant  group— that  is,  the  group 
more  likely  to  be  enrolled  in  or  eligible  for  OBEMLA  programs—would  be 
more  nearly  accurate—but  analysts  might  find  a  significant  comparison 
group  to  be  under-represented. 
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The  field  test  experience  suggests  that  in  all  but  very  small 
schools,  more  accurate  annotating  of  ethnicity  will  require  a  more 
active  role  for  the  homeroom  teacher.    Coordinators  should  be 
encouraged  to  enlist  the  participation  of  teachers  in  reviewing  the 
rosters  whenever  this  is  possible.    In  schools  with  especially  large 
eighth  grades,  where  teachers  might  find  it  burdensome  to  review  the 
entire  roster,  coordinators  could  generate  lists  by  homeroom  or  at 
least  mark  uncertain  cases  for  review,  thus  minimizing  this  burden.  A 
flexible  arrangement  will  have  to  be  worked  out  on  a  school-to-school 
basis,  to  enlist  the  help  of  teachers  at  those  sites  where  the  School 
Coordinator  is  least  able,  owing  to  size  of  eighth  grade  a.  d 
deficiencies  of  records  or  personal  knowledge,  to  provide  accurate 
ethnicity  annotations.    Inevitably,  some  undercounting  will  persist, 
and  it  will  be  an  important  goal  of  the  base  year  effort  to  minimize 
such  error. 


3.2  Student  Questionnaire  Data  Analysis 
3.2.1  Overview 


This  section  is  divided  into  seven  parts.    In  3.2.2.  we  address 
the  issue  of  critical  items  in  terms  of  their  editing,  editing  error, 
and  the  success  of  retrieval.    High  nonresponse  items  are  analyzed  in 
3.2.3.    The  probable  causes  of  nonresponse  are  pointed  to  and 
suggestions  made  for  reducing  nonresponse.  Logical  consistency  issues 
are  addressed  in  3.2.4  (inter-item  consistency  checks)  and  3.2.5 
(consistency  of  responses  to  filter  and  dependent  questions). 
Response  variation  by  position  in         questionnaire—with  special 
attention  to  whether  there  is  degradation  in  the  quality  of  data  for 
the  terminal  elements— is  examined  in  3.2.6.    Although  most  items  in 
the  NELS:88  questionnaires  are  aimed  at  one  "best  respondent" 
population  only— whether  teachers,  principals,  parents,  or  eighth 
graders— there  is  some  redundancy  in  content  across  questionnaires 
where  this  is  desirable  to  permit  analyses  of  item  validities  and 
perceptual  differences.    Content  overlaps  between  the  student  and 
parent  questionnaires  are  examined  in  3.2.7,  where  parent  and  student 
reports  on  socioeconomic  status  (SES)  indicators  and  other  items  are 
closely  compared.    Finally,  in  3.2.8,  a  reliability  analysis  is  used  to 
help  determine  the  optimal  length  of  the  attitude  scales  in  the  student 
questionnaire. 

3.2.2      Analysis  of  Editing  and  Retrieval  of  Critical  Items 

Twenty-one  questions  were  designated  as  critical  items  for  the 
field  test.    Questions  were  designated  critical  items  on  the  basis  of 
their  centrality  to  the  policy  concerns  of  NELS:88  and  to  the  follow-up 
activities  of  NEIS:90,  their  analytic  importance,  and  the  questionable 
ability  of  students  to  answer  particular  questions.    A  review  of  the 
critical  item  edit  will  address  the  effectiveness  of  the  edit  in 
assuring  high  data  quality  for  these  essential  questions.    In  addition, 
since  an  in-house  edit  was  conducted  to  evaluate  the  editing 
performance  of  the  Clerical  Assistant,  Clerical  Assistant  performance 
will  also  be  discussed. 


Each  of  the  critical  items  was  edited  by  the  Clerical  Assistant; 
and,  if  a  key  data  element  was  missing  or  ambiguous,  the  item  was 
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retrieved  by  the  Team  Leader.    In  addition,  an  in-house  edit  was 
conducted  both  to  check  the  work  of  the  Clerical  Assistant  and  to 
assure  the  highest  possible  data  quality  for  locator  items  necessary 
for  1989  field  test  follow-up. 

For  a  sample  of  schools,  Clerical  Assistant  errors  were  classified 
by  the  in-house  editor  according  to  the  inr^cf  the  error  would  have  on 
data  quality.    Error*  were  classified  as  Type  A  errors  if  they  would 
have  an  irrevocable  adverse  effect  on  data  quality.    For  example,  if  a 
student  circled  two  responses  in  Q13  for  fathers  occupation  rather 
than  one  response,  and  the  Clerical  Assistant  did  not  retrieve  the 
item,  this  was  classed  as  a  Type  A  error.    ~    the  other  hand,  Clerical 
Assistant  errors  were  classified  as  Type  B  errors  if  they  would  have  no 
effect  on  data  quality.    For  example,  Clerical  Assistants  were 
instructed  to  make  sure  that  students  actually  circled  the  number  of 
their  response,  rather  than  the  words  of  the  response.    In  many  cases, 
Clerical  Assistants  neglected  this  instruction  owing  to  time 
constraints,  but  there  was  no  effect  on  data  quality  since  we 
keypunched  the  answer  in  either  form.    Indeed,  students  will  not  be 
prone  to  make  such  errors  in  the  base  year  since  the  procedure  of 
filling  in  an  oval,  necessary  for  optically  scanned  entry  of  data 
elements,  will  eliminate  or  greatly  minimize  the  quantity  of  circling 
errors. 

In  addition  to  the  check  of  Clerical  Assistant  performance,  in  a 
subsample  of  eighth  grade  schools  retrieval  statistics  were  gathered  to 
aid  in  the  assessment  of  Clerical  Assistant  retrieval  burden;  these 
statistics  also  inform  the  analysis  of  the  edit  process. 

Two  tables  arc  provided  directly  below.    Table  3-4  is  a  list  of 
all  critical  items  in  the  two  eighth  grade  survey  instruments  (Locator 
Booklet;  Main  Questionnaire— see  List  of  Appendices  for  these 
documents),  the  number  of  data  elements,  and  substantive  content  for 
each  question.    Table  3-5  lists  the  retrieval  rates  and  Type  A  and  B 
error  rates  for  each  question.    Retrieval  rates  and  Clerical  Assistant 
error  rates  are  reported  on  a  per  case  basis. 
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TABLE  3-4 


CRITICAL  ITEMS  IN  THE  EIGHTH  GRADE  SURVEY  INSTRUMENTS 

Locator  Booklet 

Data 

Question    Elements    Substantive  Content  of  Critic  .1  Item 

Student's  name,  address,  and  telephone  r  mber 
Mother  or  female  guardian's  name 

Mother  or  female  guardian's  address  and  telephone  number 

different  from  respondent's 
Father  or  male  guardian's  name 

Father  or  male  guardian1 s  address  and  telephone  number  if 

different  from  respondent's 
Name,  address,  and  telephone  number  of  family  friend  or 
relative 

DoBs  respondent  have  a  nickname 
Nickname  of  respondent 

Respondent's  month,  date,  and  year  of  birth 
Respondent '8  sex 

Name,  city  and  atate  of  high  school  respondent  expects  to 
attend 

Type  of  high  school  respondent  expects  to  attend 
Language  other  than  English  spoken  in  home? 
What  language  do  people  in  home  usually  speak? 

Main  Questionnaire 

Substantive  Content  of  Critical  Item 

Ancestral  descent 
Race 

Special  physical  and/or  mental  impairments  of  respondent 
Father  or  male  guardian's  and  mother  or  female  guardian's 

occupations 
Educational  expectations  of  respondent 
Ability  group  of  respondent  in  four  subjects 
Respondent's  classes  this  school  year 


LQ  1  11 

LQ  2  4 

LQ  3  9 

LQ  4  4 

LQ  5  9 

LQ  7  11 

LQ  8  1 

LQ  8A  1 

LQ  9  3 

LQ  10  1 

LQ  11  3 

LQ  13  1 

LQ  20  1 

LQ  21  1 


Data 

Question  Elements 

MQ  1  1 

MQ  2  1 

MQ  9  7 

MQ  12  2 

MQ  26  1 

MQ  43  4 

MQ  44  1 


TABLE  3-5 


CRITICAL  QUESTIONS'  RETRIEVAL  AND  ERROR  RATES 


Clerical  Assistant  Errors 


Question 

Retrieval  Rate 

iype  a  error  Kate 

Type  B  Err 

LQ  1** 

nil 
•  U  31 

1  1  o 

£.  AO 

•  698 

LQ  2 

•  U  ID 

non 
•  uzu 

1  AO 

•  298 

LQ  3** 

•  Uo3 

nA7 

1  AC 

•  luo 

LQ  4 

n  in 
•  U3U 

ni  7 

•  21  j 

LQ  5** 

ill 
•  11/ 

1  IS 

.  139 

LQ  7** 

1  Cft 
•  1  JO 

1ft  A 
•  jOO 

con 
.530 

LQ  8 

nil 
•  0  33 

ni  7 

AAA 

•  220 

LQ  8A 

•  U3D 

nnn 

•  017 

LQ  9 

no  7 
•  UZ  / 

AAA 

•  271 

LQ  10 

•  U  ID 

•  UUU 

ni  n 

LQ  11 

031 

ni  a 
•  u  m 

AC/. 

•  054 

LQ  13* 

.039 

.014 

nn7 

•  uu  / 

LQ  20 

.035 

.014 

.288 

LQ  21* 

.039 

.014 

.017 

MQ  1* 

.115 

.092 

.027 

MQ  2 

.014  . 

.P90 

.007 

MQ  ;•** 

.095 

.047 

.010 

MQ  13** 

.128 

.203 

.000 

MQ  26 

.012 

.010 

.000 

MQ  43 

.020 

.014 

.003 

MQ  44* 

.052 

.020 

.112 

Means 

.054 

.058 

.147 

Single  data 

element 

.038 

.018 

.069 

Multi-data 

element 

.070 

.102 

.233 

*  Above  the  single  data  element  mean,  discussed  individually  below. 
**  Above  the  multi-data  element  mean,  discussed  individually  below. 


For  purposes  of  analysis  the  critical  items  were  divided  into  two 
groups.    One  group  was  composed  of  all  single  data  element  items,  the 
other  group  was  composed  of  all  other  critical  items.    This  was 
necessary  because  all  of  the  multi-data  element  items  registered  high 
rates  of  error  and  retrieval  when  compared  with  the  single  data  element 
items,  owing  to  the  greater  opportunity  for  retrieval  and  error  within 
the  multi-data  element  questions.    In  order  to  isolate  problematic 
questions  of  both  types,  questions  were  grouped  for  purposes  of 
analysis.    Mean  retrieval  rates  and  Type  A  and  B  error  rates  were 
calculated  for  each  group;  each  item  which  registered  above  the  mean 
for  its  group  in  either  retrieval  rate  or  Type  A  error  rate  is 
discussed  below.    Single  data  element  items  are  discussed  first,  then 
multi-data  element  items  are  discussed.    After  the  individual 
discussions  of  each  problematic  question,  an  analysis  of  the  retrieval 
burden,  overall  Clerical  Assistant  performance  of  the  critical  item 
edit,  and  the  entire  ed'ting  process  will  be  provided. 
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3.2.2.1      Single  Data  Element  Questions 


Pour  tingle  data  element  questions  registered  relatively  high 
retrieval  rates,  and  two  of  these  also  registered  relatively  high  error 
rates.    The  four  questions—Locator  Question  13,  Locator  Question  21, 
Question  1  and  Question  44 — are  discussed  below. 

Locator  Q  13     Retrieval  Rate  Type  A  Error  Rate  Type  B  Error  Rate 

•039  .014  .007 

Analysis 

Locator  Question  13  asks  the  respondent  the  type  of  high  school 
s/he  expects  to  attend.    In  an  effort  to  gather  information  on  the 
extent  of  student  knowledge  and  facility  with  the  term*  coawcnly  used 
to  classify  high  schools — general,  comprehensive,  college  preparatory, 
trade,  technical,  and  vocational — an  open-ended  category  was  provided. 
In  addition,  a  "Don't  Know"  category  was  provided. 

Thus,  it  is  somewhat  surprising  to  find  a  high  retrieval  rate  for 
this  question.    Apparently  even  tnese  measures  were  not  effective  in 
inducing  a  student  response  prior  to  retrieval.    That  students 
experienced  a  high  degree  of  difficulty  with  this  question  is  borne  out 
by  its  presence  on  the  list  of  high  nonresponse  items,  provided  later, 
principally  because  of  a  high  number  of  "Don't  Know"  responses.    On  the 
basis  of  the  edit,  however,  it  seems  clear  that  students  need  more 
information  to  assist  them  in  answering  the  question,  if  they  in  fact 
possess  the  information  to  answer  this  question  at  all.    An  examination 
of  all  open-ended  responses  provided  supporting  evidence  of  respondent 
confusion  with  the  answer  categories.    Students  responded  in  a  variety 
of  ways,  and  their  responses  included  the  following:    French  program, 
Adventist,  middle  school,  comprehensive  high  school,  educational, 
regular,  business,  and  more. 

Recommendation: 

Provide  more  explanatory  text  within  the  answer  categories,  such 
as  college  prep,  and  academic  for  college  preparatory  high  schools, 
regular  for  comprehensive  high  schools,  and  business  and  career  for 
vocational  high  schools.    In  addition,  a  category  should  be  included 
for  specialized  high  schools,  for  example,  Fine  Arts,  specialized 
science  high  schools,  and  similar  schools,  as  these  schools  are 
proliferating.    Even  with  these  additional  measures,  it  may  well  be 
that  many  eighth  graders  do  not  have  the  knowledge  of  school  and 
program  type  required  to  answer  this  question. 

Locator  Q  21      Retrieval  Rate  Type  A  Error  Rate  Type  B  Error  Rate 

•039  .014  .017 

Analysis 

This  question  is  the  first  question  in  the  minority  language 
items;  thus,  high  retrieval  on  this  question  typically  indicates 
difficulty  on  the  part  of  students  following  the  skip  pattern.  Skip 
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pattern  performance  as  a  whole  is  discussed  in  section  3.2.5  of  this 
chapter.    The  relatively  high  retrieval  rate  suggests  one  option  for 
dealing  with  skip  pattern  difficulties  for  this  critical  filter 
question  of  the  minority  language  items.    Instead  of  including  the 
items  in  either  of  the  two  booklets,  the  filter  and  dependent  items 
could  be  pieced  into  different  booklets  to  allow  survey  personnel  to 
edit  filter  items  and  designate  respondents  f~r  the  dependent 
questions.    This  would  facilitate  the  utilization  of  more  complex 
designation  rules.    Still,  an  assessment  of  the  potential  advantages  of 
such  a  system  must  be  balanced  by  an  equally  astute  assessment  of  the 
cost  of  such  a  system.    The  editing  time  used  in  designating 
respondents,  and  the  logistical  challenges  of  such  a  system  must  be 
examined. 


Recommendation: 


At  the  very  least,  use  routing  arrows  and  different  colored  pages 
to  assist  students  in  following  the  skip  pattern.    Also,  explore  the 
possibility  of  separating  the  filter  and  dependent  questions  and 
utilizing  survey  personnel  in  an  edit  of  the  filter  items  and 
subsequent  designation  of  dependent  question  respondents. 


Main  Q  1  Retrieval  Rate  Type  A  Error  Rate  Type  B  Error  Rat, 

.    .     .  -115  -092  .027 

Analysis 

The  Main  Questionnaire  Question  1  high  retrieval  rate  is  simply 
another  in  a  series  of  indications  of  the  difficulty  students  have 
categorizing  themselves  with  respect  to  ethnicity.    Iterative  pre- 
testing of  the  instruments  provided  evidence  of  one  way  to  deal  with 
this  problem.    Debriefing  of  students  suggested  that  core  students  were 
more  comfortable  with  a  list  of  broad  ethnicity  categories  than  they 
were  with  a  catch-all  negative  category  that  defined  them  in  opposition 
to  the  OBEMLA  interest  populations.    This  issue  is  treated  in  further 
detail  below  in  a  iiscussion  of  the  OBEMLA  sample  in  section  3.1.2. 
Some  suggestions  for  the  adjustment  of  this  item  are  discussed  in  the 
context  of  the  OBEMLA  interest  groups. 

Recommendation: 

To  accommodate  non-OBEMLA  interest  populations,  we  have  two 
options:    1.  add  the  broad  categories  of  African,  European,  and 
American  Indian,  and  to  properly  categorize  Asian  subgroups,  provide 
more  Asian  subcategories  to  include  Asian  groups  not  of  OBEMLA 
interest.    2.  utilize  a  skip  pattern  to  broadly  classify  students  as 
Hispanic,  Asian-Pacific  Islander,  and  Other,  with  a  dependent  question 
for  each  classification. 
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Main  Q  44  Retrieval  Rate  Type  A  Error  Rate  Type  B  Error  Rate 

.052  •  .020  .112 

Analysis 

The  high  level  of  retrieval  for  Question  44,  which  concerns 
student  courses  for  the  current  academic  year,  is  probably  related  to 
the  large  number  of  response  categories  provided.    This  large  number  of 
response  categories,  coupled  with  the  placement  of  the  item,  conspires 
to  decrease  student  attention  to  the  item.    Clerical  Assistant 
performance  on  this  question  is  far  superior  to  performance  on  Main 
Questionnaire  Question  I,  and  is  in  line  with  their  performance  on 
single  data  element  questions.    MQ44  was  categorized  as  a  single-data 
element  question  because  it  is  a  'Circle  All  That  Apply'  question. 
Thus,  tne  CA  needed  to  only  check  for  the  presence  of  one  response. 

Recommends t  i on : 

Croup  response  categories  in  a  visually  and  analytically  distinct 
manner.    For  example,  core  courses  such  as  Math,  English,  Science,  and 
Social  Studies  might  be  grouped  together  under  the  heading  of  Core 
Courses,  while  all  other  courses,  such  as  foreign  language,  health 
education,  and  drama  might  be  grouped  under  Electives.    Or,  all 
Mathematics  courses  might  be  grouped  under  Math  (there  are  four 
options),  all  Science  courses  (there  are  four  options)  under  Science, 
and  similarly  for  all  subjects.    A  third  option  is  to  turn  the  question 
with  twenty-five  response  categories  into  four  sub-questions  with  Math, 
Science,  Other  core  courses,  and  electives  grouped  together.    Any  one 
of  these  three  options  should  increase  data  quality  if  the  item  is 
again  designated  critical  by  allowing  the  CA  to  check  for  an  answer  to 
every  sub-question. 

3.2.2.2      Multi-data  Element  Questions 

Pive  multi-data  element  questions  registered  relatively  high 
ieval  rates,  and,  of  these,  three  also  registered  relatively  high 
error  rates.    In  addition,  one  question  registered  a  high  error  rate. 
The  six  questions— Locator  Question  I,  Locator  Question  3,  Locator 
Question  5,  Locator  Question  7,  Question  9  and  Question  13  —  are 
discussed  below. 

Locator  Q  1       Retrieval  Rate  Type  t.  Error  Rate  Type  B  Error  Rate 


retr 


Analysis 


.031  .119 


.698 


As  noted  above,  eleven  data  elements  are  directly  derived  from 
this  question.    The  high  Type  B  error  rate  can  be  explained  by  the 
breakdown  of  the  student's  address.    Instructions  called  for  survey 
personnel  to  retrieve  all  missing  items.    The  layout  of  Locator 
Question  1  (and  Locator  Questions  3,  5,  and  7)  treats  "Apartment 
Number    as  a  separate  item,  and  therefore  an  item  that  should  be 
retrieved  if  missing.    Clerical  Assistants  did  not  retrieve  this 
information,  but  its  absence  is  of  small  importance;  generally  students 
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with  an  apartment  number  filled  it  in,  whereas  students  without  an 
apartment  number  left  it  blank.    This  also  is  reflected  in  the 
relatively  low  retrieval  rate. 

The  seeming  incidence  of  Type  A  error  is  troubling.    However,  the 
missing  information  typically  is  the  area  code  or  zip  code,  data 
elements  that  can  usually  be  obtained  from  other  sources.    Missing  area 
codes  are  simple  to  provide  if  the  remaining  information  is  provided, 
aa  it  usually  is.    In  the  case  of  the  zip  code  the  in-house  edit 
process  is  a  bit  more  involved  but  no  less  successful.    If  the  zip  code 
is  not  retrieved  in  the  field  it  can  usually  be  obtained  from  the 
information  provided  by  other  students  in  the  school.    Only  in  large 
cities  with  several  zip  codes  would  it  be  impossible  to  obtain  this 
information  directly  from  the  data  supplied  by  other  students,  and  in 
this  case  if  the  remaining  information  is  supplied,  a  zip  code 
directory  can  be  unflized. 

Thus,  from  the  information  provided  by  the  edit,  it  seems  that 
Locator  Question  1  is  effective  in  obtaining  data  from  the  students, 
and  in  cases  where  Apartment,  Area  Code,  and  Zip  Code  data  are  not 
retrieved  in  the  field  the  data  is  either  unnecessary  for  the 
particular  case  or  easily  obtained  with  Central  Office  procedures. 

Recommendation: 

Retain  this  item  as  is. 

Locator  Q  3       Retrieval  Rate  Type  A  Error  Rate  Type  B  Error  Rate 

.083  .047  .105 

Analysis 

Locator  Question  3  asks  for  the  address  of  the  female  guardian  if 
the  student  does  not  live  with  the  female  guardian.    This  question  had 
a  high  retrieval  rate,  with  low  incidence  of  Type  A  and  Type  B  error. 
The  high  retrieval  rate  (one-third  higher  than  the  mean  retrieval  rate 
for  all  critical  items)  is  a  function  of  two  features  of  this  question. 
First,  this  question  has  imbedded  within  it  a  second  order  skip 
pattern,  which  might  have  created  some  degree  of  confusion  for 
students.  (Skip  pattern  performance  is  discussed  in  detail  in  section 
3.2.i.)  Second,  many  students  may  not  know  all  elements  of  the  address 
of  a  parent  with  whom  they  do  not  live,  and  their  lack  of  knowledge 
would  necessitate  a  retrieval. 

Still,  there  seems  to  be  no  way  to  effectively  and  efficiently 
address  these  difficulties  without  introducing  other  methodological 
difficulties.    The  question  will  have  to  stand  on  its  own. 

Recommendation: 

Retain  this  item  as  is. 
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Locator  Q  S 


Retrieval  Rate 
.117 


Type  A  Error  Rate 
.125 


Type  B  Error  Rate 
.139 


Analytit 


Locator  Question  5  is  the  father  or  male  guardian  correlate  of 
Locator  Question  3.    In  statistical  terms,  though  the  Type  B  error 
rates  for  the  two  questions  are  similar,  there  the  similarity  ends. 
The  Type  A  error  rate  for  Locator  Question  5  is  approximately  twice  the 
mean  of  all  critical  items,  and  slightly  less  than  three  times  that  of 
Locator  Question  3.    In  addition,  the  retrieval  rate  is  much  higher  for 
Locator  Question  5  than  for  Locator  Question  3. 

Still,  what  is  observed  is  simply  an  increase  in  the  degree  of  the 
problem,  rather  than  the  emergence  of  a  different  problem  altogether. 
The  difference  in  retrieval  rates  can  be  explained  by  the  presumably 
greater  incidence  of  households  with  only  a  female  guardian  as  compared 
to  households  with  only  a  male  guardian.    Therefore,  more  students 
would  be  living  in  a  situation  which" called  upon  them  to  answer  this 
question.    All  other  factors  mentioned  for  Locator  Question  3  hold  true 
for  this  question  also,  because  the  formatting  of  the  two  questions  is 
precisely  parallel.    Thus,  the  presence  of  a  second  order  skip  pattern 
within  the  question  and  the  lack  of  student  knowledge  of  address 
information  for  guardians  with  whom  they  do  not  live  have  the  same 
effect  here  as  they  do  in  Locator  Question  3,  only  more  so  owing  to  the 
higher  number  of  students  affected  by  the  question.    This  effect  is 
registered  in  both  the  high  retrieval  rate  and  the  high  Type  A  error 
rate       the  more  times  this  particular  question  would  be  answered  by 
students,  the  more  opportunities  for  error. 

Tc  assess  the  importance  of  Type  A  error  it  is  necessary  to  focus 
more  directly  upon  the  particular  types  of  errors  Clerical  Assistants 
made  with  this  question.    Clerical  Assistant  errors  were  typically 
errors  of  omission  rather  than  commission.    Thus,  the  greater  part  of 
the  errors  should  have  been  retrieved;  adding  this  error  race  to  the 
retrieval  rate  provides  a  better  indication  of  the  level  of  retrieval — 
.242.    Still,  the  Type  A  error  rate  itself  is  explained,  as  is  the 
drastic  difference  between  Clerical  Assistant  performance  with  Locator 
Question  3  and  5,  on  the  basis  of  greater  student  uncertainty  with 
respect  to  this  item. 

Parenthetically,  it  is  worth  noting  that  the  retrieval  of  Locator 
Questions  3  and  5  is  by  and  large  mutually  exclusive.    In  other  words, 
cases  retrieved  because  of  Locator  Question  3  are  not  retrieved  because 
of  Locator  Question  5,  and  vice  versa.    Thus,  approximately  twenty 
percent  of  the  time  one  of  these  two  questions  is  retrieved.  When 
considered  in  the  light  of  a  retrieval  rate  of  1.12  retrievals  per 
case,  these  two  questions  account  for  approximately  one-sixth  of  the 
total  retrievals. 

Recommendation: 

Retain  this  item  as  is. 
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Locator  Q  7       Retrieval  Rate  Type  A  Error  Rate  Type  B  Error  Rate 

•158  .388  .530 


Analysis 

Locator  Question  7  asks  for  the  name,  addrens,  aad  telephone 
number  of  the  family1*  closest  friend  or  relative.    Both  the  retrieval 
rate  and  the  Type  A  error  rate  are  above  the  mean  on  this  question. 
The  retrieval  rate  can  be  explained  in  that  many  students  did  not  have 
full  address  information  for  family  acquaintances.    The  high  error 
rate,  however,  is  more  related  to  the  large  number  of  data  elements 
within  the  question.    Eleven  data  elements  make  up  this  question;  thus, 
the  error  per  data  element  per  case  is  .0353. 

Area  codes,  phone  numbers,  states,  and  sip  codes  were  the  data 
elements  typically  at  the  center  of  a  Type  A  error.    Among  these 
elements,  the  rip  code  is  of  least  importance.    Phone  numbers  are  most 
important  for  this  item,  followed  by  area  code  and  state.  State 
becomes  important  only  if  there  is  no  area  code.    Still,  Clerical 
Assistant  performance  on  this  particular  question  was  not  up  to  par, 
and  will  need  to  be  addressed  in  the  training  for  the  base  year.  In 
addition,  if  the  question  is  again  desiguated  a  cricical  item  in  the 
base  year,  consideration  might  be  given  to  restricting  the  data 
elements  in  need  of  retrieval  to  those  most  likely  to  be  used  in 
follow-up  efforts,  namely,  phone  information. 

Reconmendat  i  on : 


Target  particular  data  elements  for  retrieval  if  the  question  is 
again  designated  a  critical  item  in  the  base  year.    Data  elements 
suggested  for  specific  targeting  include  Last  and  First  Name,  City, 
State,  and  Phone  Number. 

Main  Q  "  Retrieval  Rate  Type  A  Error  Rate  Type  B  Error  Rate 

•095  .047  ,010 

Analysis 

Questions  9C  and  9G,  portions  of  Question  9,  are  also  discussed  in 
section  3.2.3.1  in  the  analysis  of  item  nonresponse.    In  point  of  fact, 
the  question  referred  to  as  Question  9  is  really  a  series  of 
independent  questions  concerning  special  services  students  may  have 
received  owing  to  particular  types  of  health  conditions.  These 
questions  have  similar  nonresponse  rates.    The  problems  with  the 
question  are  best  discussed  in  the  context  of  nonresponse,  since  the 
retrieval  rate  is  principally  the  effect  of  the  large  number  of  data 
elements  in  the  question  (7). 


Recommendation: 


See  discussion  in  3.2  7.2. 
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Main  Q  13  Retrieval  Rate  Type  A  Error  Rate  Type  B  Error  Rate 

•128  .203  .000 

Analysis 


Quest  ion  13  is  the  parental  occupation  question*    It  registers  a 
hifch  retrieval  rate,  a  high  Clerical  Assistant  Type  A  error  rate,  and  a 
high  nonresponse  rate,    (it  does  not  register  a  high  Type  B  ei.or  rate 
because  all  Clerical  Assistant  errors  in  Question  13  were  classed  as 
Type  A  errors.)    In  addition,  student  use  of  the  response  categories  is 
not  entirely  consistent;  this  phenomenon  is  discussed  in  greater  dei^'l 
in  sections  3,2. 3,1  (on  item  nonresponse)  and  3.2.7  (on  rtudent  versus 
parent  reports). 

The  question  exhibits  such  high  retrieval  rates  because  students 
do  not  have  sufficient  information  about  their  parents1  occupations  to 
categorise  the  occupation.    Much  of  the  retrieval  was  to  correct 
imiltiple  responses  made  by  students  as  they  sought  to  aptly 
characterise  their  parent's  occupations.  Indeed,  the  largest  category 
of  in-school  edit  error  is  failure  to  resolve  multiple  responses.  The 
word  ,ferror,f  here  may,  however,  be  somewhat  unfair  to  the  Clerical 
Assistant.^  If  a  question  elicited  illegitimate  multiple  response,  the 
on-site  editor  could  point  this  out  to  the  student  and  could  ask  the 
student  to  try  to  pick  the  one  that  fit  best— but  students  were  often 
unable  or  unwilling  to  make  this  choice.    Clerical  Assistants  were  not 
allowed  to  interpret  the  choices,  guide  the  student  to  a  particular 
category  on  the  basis  of  information  provided,  or  code  a  particular 
response  as  over-riding  of  others.    In  these  circumstances,  failure  to 
receive  a  large  number  of  multiple  responses  is  understand  ible,  and 
many  of  these  Type  A  errors  represent  situations  where  they  quite 
properly  carried  their  interventions  as  far  as  they  were  allowed  to  go. 

It  would  seem  extremely  difficult  to  alter  this  question  to  lower 
the  level  of  retrieval  or  the  level  of  error  and  nonresponse  and  still 
maintain  needed  parallelism  to  the  US&B  and  NLS-72  occupation 
questions.    Clerical  Assistant  error  is  related  to  the  combined  student 
lack  of  information  about  parental  occupation  and  inability  to  use  the 
Census  occupation  categories  in  that  Clerical  Assistants  cannot  elicit 
responses  from  students  lacking  in  information.    Many  children  will 
claim  co  know  their  parents1  occupations.    In  fact,  they  may  know  their 
parental  occupation  yet  still  not  possess  enough  information  to 
classify  the  oo   ^ation  according  to  the  standard  classifications. 
This  refusal  of  students  to  acknowledge  their  inability  to  utilize  the 
closed  categiries  provided  registers  as  a  Clerical  Assistant  error.  If 
students  do  not  say  that  they  don't  know,  Clerical  Assistants  could  not 
us*  the  "Don't  Know"  response. 

Recommendation: 

If  sufficient  occupation  data  can  be  obtained  from  parents,  this 
item  should  not  be  retained  on  the  student  questionnaire. 
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3.2.2.3     Retrieval  Burden 


The  retrieval  rate  of  all  questions  together  was  1.12  retrievals 
per  case.    Thus,  on  average ,  each  case  needed  to  be  retrieved  *or  at 
least  one  question.    This  high  retrieval  rat*  was  concentrated,  as 
discussed  briefly  above,  in  Locator  Questions  3,  5,  and  7,  and  Main 
Questionnaire  Questions  1  and  13.    These  five  questions,  approximately 
23  percent  of  the  critical  items,  accounted  for  54  percent  of  the 
retrieval.    The  breakdown  per  question  is  listed  below  in  Table  3-6: 

TAB LP  3-6 

HIGH  RETRIEVAL  RATE  CRITICAL  QUESTIONS 

Question 

Locator  Question  3 
Locator  Question  5 
Locator  Question  7 
Main  Questionnaire  Question  1 
Main  Questionnaire  Question  13 


Retrieval  Rate  Percent  of  Retrieval 
.083  7. 42 

•117  io.4Z 
•158  14. 1Z 

•115  10. 3Z 

.128  hat 


This  is  a  high  level  of  retrieval,  and  the  changes  suggested  above 
aim  at  making  items  retained  and  designated  critical  in  the  base  year 
as  clear  as  possible  in  order  to  facilitate  student  succesc  with  the 
items  prior  to  an  edit  and  retrieval. 

3.2.2.4  Clerical  Assistant  Performance  of  Critical  Item  Edit 

In  the  light  of  the  massive  amount  of  retrieval  necessary,  which 
signals  a  high  degree  of  Clerical  Assistant  editing  activity,  the 
performance  of  Clerical  Assistants  was  exemplary.    Still,  Clerical  Assistant 
performance  was  not  exemplary  on  some  particularly  difficult  questions, 
regardless  of  the  retrieval  burden  thereby  imposed.    In  the  light  of  this 
field  test  experience,  it  will  be  advisable  to  train  th<  Clerical  Assistant 
for  the  base  year  on  particularly  difficult  questions  ex^xcitly,  while 
still  providing  the  general  guidelines  applicable  to  every  situation. 
Better  Clerical  Assistant  training  on  these  questions  may  actually  increase 
the  amount  of  retrieval  above  the  field  test  levels;  however,  adjustments  in 
difficult  critical  items  discussed  above  may  help  to  hold  constant  or 
somewhat  reduce  the  retrieval  burden. 

3.2.2.5  Conclusion 

The  field  edit  was  successful  in  assuring  high  data  quality  in  cases 
where  students  possess  3d  relevant  information.    No  process  can  elicit 
meaningful  locator  or  parental  occupation  information  from  respondents  that 
do  not  possess  such  information.    As  suggested  above,  the  training  of  the 
Clerical  Assistant  will  pay  particular  attention  to  difficult  questions. 
This  will  entail  revision  of  the  Clerical  Assistant  manual  to  some  degree. 
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Retrieval  rates  will  be  lowered  for  some  questions  when  the 
questionnaire  is  re-formatted  for  scanning.    For  other  questions  adjustments 
suggested  by  the  edit  will  lower  retrieval  and  increase  data  quality.  For 
Bt^\  questions,  «uch  as  the  locator  information,  conditions  will  not 

be  significantly  altered  by  the  scan  edit,  and  barring  other  adjustments 
retrieval  rates  should  remain  at  the  level  observed  in  the  field  test. 

3.2.3     Student  Questionnaire  Data:    Item  Nonresponse 

In  this  section,  several  issues  pertaining  to  item  nonresponse  in  the 
field  test  student  questionnaire  data  are  addressed.    First  is  an 
explanation  of  how  the  high  nonresponse  items  were  identified  and  selected. 
This  is  followed  by  a  list  of  the  high  nonresponse  items.    Then,  each  item 
is  analysed  in  turn.    The  clarity  of  the  question  is  considered  as  well  as 
the  format  and  logic  of  the  questionnaire.  Where  these  are  not  problematic, 
other  factors  are  considered.    These  include  the  relationship  between  the 
information  sought  and  the  probable  knowledge  of  eighth  graders  and  the 
characteristics  of  the  nonresponse  population.    Where  appropriate, 
modifications  of  questionnaire  format  or  changes  in  item  wording  that  might 
reduce  nonresponse  are  proposed. 

3.2.3.1      Item  Nonresponse  in  the  NBLS;88  Student  Questionnaire 

The  starting  point  in  this  analysis  wac  to  define  the  nonresponse 
problem  by  designating  as  problematic  all  variables  that  had  8  percent  or 
higher  nonresponse  when  all  legitimate  skips  were  excluded  from  the  expected 
response.    However,  for  the  critical  items  in  their  final,  field-edited 
form,  a  more  stringent  criterion  of  5  percent  was  set. 

Thus,  the  forimila  used  to  compute  the  response  rate  was: 


Response  rate  -  number  of  valid  responses  +  number  of  valid  skips 

number  of  applicable  respondents. 

Since  "valid  response"  could  be  interpreted  in  several  ways,  it  i3 
important  to  note  that  nonresponse  was  also  categorized  as  to  kind.  The 
following  nonresponse  codes  were  us<»d  to  designate  invalid  responses: 
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FIGURE  1:    Nonresponse  Codes  in  the  Student  Questionnaire  Data. 

CODE  NUMERIC 

CONVERSION  DESCRI PTION 


The  respondent  refused  to 
answer  an  item  either  by 
written  notation  in  the 
questionnaire,  verbal  report 
to  the  editor,  or  both. 

A  Don't  Know  option  was 
provided  in  the  response 
categories  and  was  utilized 
by  the  respondent. 

The  respondent  gave  several 
answers  to  a  question  when  the 
directions  called  for  only  one. 

An  item  was  left  blank  or 
uncircled,  though  a  response 
was  required. 

^  While,  for  purposes  of  this  analysis,  we  have  regarded  all  nonresponse 
as    invalid,"  it  is  nonetheless  important  to  distinguish  types  of 
nonresponse  in  terms  of  their  "legitimacy."    Nonresponse  could  be 
"legitimate"  or  "illegitimate"— that  is,  some  forms  of  nonresponse  were 
licensed  by  item  response  categories  or  oy  questionnaire  routing 
instructions,  while  others  were  not.  For  example,  a  Don't  Know  option  may 
have  been  provided  and  used;  or  the  respondent  may  legitimately  have  skipped 
the  question,  by  properly  following  routing  instructions.    We  have  excluded 
legitimate  skips    (where  the  respondent  should  not  have  answered  the 
question  and  did  not)  from  analysis.    However,  the  other  form  of  legitimate 
nonresponse— opting  for  an  explic     Don't  Know  category—has  been  included 
in  the  nonresponse  analysis,  since,  unlike  the  legitimate  skips  but  like  the 
illegitimate  nonresponse  categories,  it  is  a  marker  of  data  that  are  desired 
but  have  not  been  provided.  Also  included  in  the  analysis  are  all  forms  of 
illegitimate  nonresponse— refusal  to  answer  a  question,  failure  to  answer  a 
question,  or  giving  multiple  responses  where  only  one  response  is  called 
for.    In  order  to  define  problematic  items,  all  form*  of  illegitimate 
nonresponse,  and  Don't  Knows,  were  summed.    Again,  if  total  nonresponse 
exceeded  8  percent  (or  5  percent  for  a  critical  item),  the  item  was 
designated  problematic,  and  has  been  included  in  this  analysis.    The  cable 
below  lists  the  high  nonresponse  variables  in  the  field  test  Student 
Questionnaire. 
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REFUSED  7, 

97 


DK  8, 

98 


MULTIPLE 
RESPONSE 


MISSING  9, 
99 


126 


TABLE  3-7  . 
HIGH  NON RESPONSE  ITEMS 
Mote:    Locator  Book  items  are  prefaced  with  L,  Main  Questionnaire  with  Q 

*  *  also  a  critical  item 
TYPE  OP  NONRESPONSE 
Refused      Don't  Know  Multiple 


Lll* 

CITY  OP  SCHOOL  R 
EXPECTS  TO  ATTEND 

LI  3* 

WHAT  KIND  OP  U.S. 

JS  T  " 

4REA  OP  WORLD 
ANCESTORS  LIVED 

Q3C 

N  OP  ASIAN  STUDENTS 
IN  R'S  CLASS 

Q9C  * 

SPECIAL  SERVICES 
FOR  DEAFNESS 

Q9C* 

SPECIAL  SERVICE 
FOR  MAJOR  HEALTH 
PROBLEM 

Q13A* 

OCCUPATION  CATEGORY 
OP  R'S  FATHER 

Q13B* 

OCCUPATION  CATEGORY 
OP  R'S  MOTHER 

QUA 

HIGHEST  LEVEL 
OP  ED  R'S  FATHER 
COMPLETED 

Q14B 

HIGHEST  LEVEL  OP 
ED  R'S  MOTHER 
COMPLETED 


.3Z 


.2Z 


1.2Z 
31. 3Z 


.11 


.11 


.1Z 


8.4Z 


6.0Z 


21. 4Z 


.6Z 


3.4Z  3.2Z 


.1Z 


8.6Z 


7.5Z 


6.7Z 


18. 5Z 


7.2Z 


Missing  Total 

3.8Z  5.0Z 

.5Z  32. 4Z 

2.5Z  9.1Z 

9.5Z  9.7Z 

4.9Z  5.0Z 

5.6Z  5.7Z 

7.6%  24. 9Z 

5.2Z  18. 9Z 

6.7Z  34. 8Z 

4.8Z  30. 5Z 
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Refused     Don't  Know     Multiple        Missing  Total 

HAVE  R'S  PARENTS 
ATTENDED  A  SCH  MEETING  — 


Q18B 

HAVE  R'S  PARENTS 
SPOKEN  TO  R'S  TEACHER 


9.4Z 


10. 31 


2.8Z       12. 21 


1.7Z  12Z 


Q18C 

HAVE  R'S  PARENTS 
VISITED  THE  CLASS  ROOM 

Q23B 

HOW  MANY  HOURS  ON 
WEEKENDS  R  WATCHES  TV 


5.8Z 


1.7Z 


3.0Z  8.8Z 


7.21  9.9Z 


02  7 A 

HOW  PAR  IN  SCH  DOES 
R'S  DAD  WANT  R  TO  GO 

Q27B 

HOW  PAR  IN  SCH  DOBS 
R'S  MOM  WANT  R  TO  CO 

Q28 

WHICH  H.S  PROGRAMS  WILL 
YOU  ENROLL  IN 

Q29C 

HOW  OFTEN  R  TALKS 

W/A  GUIDANCE  COUNSELOR 

Q33 

DID  R  TAKE  TEST 
INDICATING  APTITUDE 

WHAT  KIND  OP  WORK  R 
WILL  BE  DOING  AT  30 

Q43A  * 

WHAT  ABILITY  GROUP 
IS  R  POR  MATHEMATICS 

Q43B  * 

WHAT  ABILITY  GROUP 
IS  R  POR  SCIENCE 


.1Z 


.1Z 


10. 2Z  3.6Z 


8.9Z  4.2Z 


27. 8Z  2.0Z 


24. 7Z  .1Z 


12. 2Z  5.3Z 


5.5Z 


6.5Z 


.3Z 


.4Z 


12. 2Z  26Z 


3.8Z       16. 9Z 


1.2Z  31Z 


8.1Z  8.1Z 


3.4Z       28. 2Z 


2.3Z       20. 3Z 


.51  6.4Z 


.7Z  7.7Z 
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Refused     Don't  Know     Multiple         Missing  lv>tal 

Q43C  * 

WHAT  ABILITY  GROUP  IS  R 

FOR  ENGLISH  .IX  5.5Z  .3Z  .52  6.4Z 


04 3D* 

WHAT  ABILITY  GROUP  FOR 
SOCIAL  STUDIES  .1Z 

Q49A 

MATHEMATICS  CLASS  IS 
USUALLY  PUN  — 

Q49B 

I  USUALLY  LOOK  FORWARD 

TO  MATH  CLASS  — - 

Q49D 

MATH  WILL  BE  USEFUL 

IN  MY  PUTURE  ~ 


Q50A 

ENGLISH  CLASS  IS 
USUALLY  FUN 

Q50D 

ENGLISH  WILL  BE  USEFUL 
IN  MY  FUTURE 


6.9Z  .3Z  .7Z  8Z 

4-7Z  .1Z  3.3Z  8.1Z 

7-  C*  —  3.3Z  10. 3Z 

8-  OZ  .12  3.2Z  11. 3Z 

*-5Z           —  3.3Z  9.8Z 

9-  5Z            .1Z  3.2Z  12. 7Z 


Q51A 

SOCIAL  STUDIES  CLASS 

IS  USUALLY  FUN  ~  4.4Z  _  ,y.9Z  8>3Z 


Q51B 

I  USUALLY  LOOK  FORWARD 
TO  SOCIAL  STUDIES 


4.7Z 


.1Z 


3.9Z 


8.7Z 


Q51D 

SOC.  STUDIES  WILL  BE 

USEFUL  IN  MY  FUTURE  -  16.6Z  .U  3.9Z  20.6Z 


Q52D 

SCIENCE  WILL  BE  USEFUL 
IN  MY  PUTURE 


14. 8Z 


,3Z 


3.2Z 


18. 3Z 
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Refused     Don't  Know     Multiple        Missing  Total 

Q56B 

DID  R  CO  TO  DAY  CARE  -  i0.8Z  -  12. 2Z  23Z 

Q56C 

DID  R  00  TO  NURSERY 

SCHOOL  OR  PRESCHOOL  -  8.1Z  -  8.5Z  16.6Z 

Q56D 

DID  R  GO  TO  HEAD  START       —  19. 5Z  —  33.53 

Q56E 

DID  R  00  TO  EXTENDED 

DAY  SCHOOL  -  24Z  -  15Z  39Z 


Overall,  item  nonresponse  in  the  Main  Questionnaire  ranged  from  a  high  of  39 
percent  (itesi  56B,  "Did  you  go  to  extended  day?")  to  lows  of  less  than  1  percent 
on  both  behavioral  and  attitude  questions  (for  example,  question  24  on  cigarette 
smoking;  question  25A,  a  self-esteem  item),  with  a  mean  of  5.86  percent.  When 
Don  t  Knows  are  excluded  from  the  calculation,  mean  item  nonresponse  was  4.05 
percent. 

3.2.3.2     Item-by-Item  Analysis 

LllCITY     CITY  OP  SCHOOL  R  EXPECTS  TO  ATTEND  Critical  Item 

Response  frequencies  for  locator  question  ll~name  of  city  of  school 
respondent  expects  to  attend  in  G.ade  10— are  given  below.    (Note:  the  meaning  of 
valid    in  the  tables  below  does  not  correspond  to  "valid"  in  the  formula  for 
computing  response  and  nonresponse.) 

Valid  Cum 

Value  Label  Value    Frequency    Percent    Percent  Percent 


98 

16 

1.2 

1.2 

3.1 

99 

53 

3.8 

3.8 

5.0 

Valid  Name 

1307 

95.0 

95.0 

100.0 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1376  Missing  Cases  0 


Because  this  is  a  critical  item,  five  percent  nonresponse  was  the 
cutoff  criterion  that  determined  this  was  a  problematic  variable.    In  face, 
Lll  is  a  three-part  item  that  asks  for  school  name,  city  and  state.  Of 
these  three  elements,  the  least  known  (5  percent  nonresponse)  is  city. 
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Sine*  being  able  to  answer  at  to  city  it  contingent  on  having  torn?  notion 
what  tchool  on*  will  attend  and  2.9  percent  of  the  sample  were  not  able  to 
n*^e  a  school,  nonresponse  attributable  to  not  knowing  the  city  name  was 
only  2.1  percent.  It  is  reasonable  to  suppose  that  a  modest  percentage  of 
students  will  not  have  any  idea  where  they  will  be  attending  tenth  grade. 
In  urban  areas,  for  example,  there  is  sometimes  a  wide  range  of  school 
possibilities.    An  extreme  example  of  this  is  New  York  City,  where  normally 
each  student  has  a  choice  of  ten  schools  to  which  he  or  she  may  apply,  and 
though  students  are  assured  of  admission  at  least  to  the  nearest 
comprehensive  high  school,  they  cannot  be  certain  which,  if  any,  of  the 
specialized  high  schools  will  accept  them.  Most  of  the  respondents  who  left 
blanks  (9,  99)  for  city  answered  Don't  Know  to  the  school  name  element  of 
the  question.     That  two  i..!rcent  of  the  sample  did  not  indicate  city 
represents  a  small  additional  number  who  named  a  school  but  not  the  city 
(the  sixteen  98s)  plus  a  number  (14,  or  approximately  1  percent)  of 
illegitimate  blanks.  These  blanks  should  have  been  screened  in  the  in-school 
edit  and  an  answer,  or  refusal,  or  Don't  Know  response  elicited  from  the 
student  and  coded  by  the  Survey  Team.  The  low  rate  of  illegitimate 
nonresponse  for  this  question  suggests  that  no  item  or  questionnaire  format 
revisions  arc  required. 

Locator  question  13  was  discussed  as  a  high-retrieval  edit  item  in 
3.2.2  above.    This  question  asked  what  kind  of  high  school  the  respondent 
expected  to  attend  in  tenth  grade.    Again,  it  is  probably  unrealistic  to 
expect  those  who  did  not  know  what  school  they  were  likely  to  attend  to 
characterise  the  type  of  school.    But  as  noted  above,  only  2.9  percent  of 
the  sample  was  unable  to  name  a  probable  tenth  grade  school.    This  lack  of 
knowledge  of  the  school  explains  only  a  very  small  part  of  the 
extraordinarily  high  nonresponse  as  to  school  program  or  type,  as  reflected 
in  the  response  frequencies  below. 

L13SCH00L    WHAT  KIND  OP  HIGH  SCHOOL  IS  IT?  Critical  Item 


Value  Label  Value 

GBN/CMPRBHNSVB  H,S.  1 

COLL  PREP  H.S.  2 

TRADE/TECH /VOC  H.S  3 

0THER  4 

DK  8 
MULTIPLE 

MISSING  9 

TOTAL 

Valid  Cases       1361  Missing  ( 


Valid 

Cum 

luency 

Percent 

Percent 

Percent 

715 

52.0 

52.5 

52.5 

136 

9.9 

10.0 

62.5 

43 

3.1 

3.2 

65.7 

37 

2.7 

2.7 

68.4 

430 

31.3 

31.6 

100.0 

10 

.6 

MISSING 

5 

.5 

MISSING 

1376 

100.0 

100.0 

15 


The  fact  that  this  question  was  edited  in  the  classroom  no  doubt 
explains  the  low  level  of  illegitimate  blanks  (code  9),  at  one  half  of  one 
percent.    There  is  also  a  small  number  of  multiple  responses  (.6  percent). 
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However,  o\*r  31  percent  of  respondents  have  indicated  that  they  do  not  know 
what  kind  of  high  school  they  will  enroll  in.    In  iterative  pretesting  with 
siiall  groups  during  cht  questionnaire  development  process ,  we  found  a 
similar  proportion  of  students  unable  to  characterise  their  intended  high 
schools,  and  although  these  pretest  respondents  usually  had  a  good  idea 
which  school  they  were  likely  to  attend,  they  found  it  almost  as  difficult 
to  characterize  the  kind  of  program  in  which  thev  would  enroll  as  the  type 
of  high  school. 

If  indeed  so  little  is  known  about  high  school  programs  and  types  at 
this  critical  transition  period,  this  fact  becomes  a  research  datum  in 
itself,  with  possible  policy  implications.    However,  we  will  further  consult 
with  school  officials  and  educational  researchers  to  see  if  these  basic 
categories  may  be  glossed  with  language  likely  to  be  more  meaningful  to 
eighth  graders. 

Question  1  in  the  main  questionnaire  was  also  a  high  retrieval  item, 
and  has  been  discussed  in  3.2.2.    This  question  asks  students  what  areas  of 
the  world  their  ancestors  lived  in  before  coming  to  America.  Its  essential 
purpose  is  to  permit  all  respondents  to  be  categorised  into  Hispanic  (with 
subgroup  breakdowns),  Asian  or  Pacific  Islander  (with  subgroup  breakdowns), 
or  other  (neither  Hispanic  nor  Asian/Pacific  Islander).    Despite  the  in- 
school  edit,  non response  runs  over  9  percent,  owing  to  multiple  responses, 
in  which  the  respondent  incorrectly  opted  for  more  than  one  category;  Don't 
Knows;  and  illegitimate  blanks  (question  not  answered). 


Ql 


AREA  OP  WORLD  ANCESTORS  LIVED  BEFORE  U.S  Critical  Iti 


Value  Label 


Valid  Cum 
Value    Frequency    Percent    Percent  Percent 


MEXICAN 

1 

12T 

8.7 

9.3 

9.3 

CUBAN 

2 

54 

3.9 

4.2 

13.4 

PUERTO  RICAN 

3 

25 

1.8 

1.9 

15.3 

OTHER  HISPANIC 

4 

58 

4.2 

4.5 

19.8 

CHINESE 

5 

28 

2.0 

2.2 

22.0 

FILIPINO 

6 

32 

2.3 

2.5 

24.4 

JAPANESE 

7 

11 

.8 

.8 

25.3 

KOREAN 

8 

11 

.8 

.8 

26.1 

SOUTH  ASIAN 

9 

20 

1.5 

1.5 

27.7 

PACIFIC  ISLANDER 

10 

15 

1.1 

1.2 

28.8 

OTHER  ASIAN 

11 

49 

3.6 

3.8 

32.6 

NEITHER  HISPANIC  NOR  API 

12 

827 

60.1 

63.8 

96.4 

DK 

98 

47 

3.4 

3.6 

100.0 

MULTIPLE 

44 

3.2 

MISSING 

MISSING 

99 

35 

2.5 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1297 

Missing  Cases 

79 

93 


ERJ.C 


132 


The  response  frequencies  show  the  need  for  a  tighter  edit  in  the  base 
yeei — too  many  blanks  (2.5  percent)  and  multiple  responses  (3.2  percent) 
were  not  resolved  by  editors.    As  noted  in  the  discussion  of  this  item  in 
3.2.2,  in  iterative  pretesting— and  also  in  survey  sessions,  according  to 
Team  Leader  reports—many  non-Hispanic  and  non-Asian-Pacific  respondents 
expressed  frustration  that  there  was  no  place  to  put  themselves  other  than 
the  ratch-all    neither"  category.    Undoubtedly  some  number  of  blanks,  Don't 
Knows,  and  incorrect  attributions  of  Hispanic  or  Asian-Pacific  ethnicity, 
was  born  of  that  frustration.    Inclusion  of  broad  categories  of  origin  for 
other  groups— for  example,  Europe  and  Africa— while  it  would  provide 
information  of  possibly  no  more  than  marginal  analytic  interest,  might 
lessen  respondent  frustration  and  error. 

Question  3,  subpart  C,  asked  how  many  students  in  the  respondent's 
grade  are  Asians  or  Pacific  Islanders.    Subparts  A  and  B  asked  how  many 
students  were,  respectively,  black  and  Hispanic— there  was  3.3  percent 
nonresponse  in  respect  of  blacks,  6.9  percent  in  respect  of  Hispanics,  and 
9.6  percent  in  respect  of  Asians/Pacific  Islanders.    Versions  of  3A  and  3B 
Ibut  not  of  3C)  were  asked  in  the  High  School  and  Beyond  base  year  (1980). 
Nonresponse  for  HS&B  sophomores,  asked  about  proportion  of  blacks  in  their 
ninth  grade  classes,  was  7.6  percent;  nonresponse  when  asked  about 
proportion  of  Hispanics  was  7.5  percent. 


Q3C 


#  OP  ASIAN  STUDENTS  IN  R'S  CLASS 


Value  Label 

NONE 

A  PEW 

ABOUT  HALF 

MOST 

ALL 

DK 

MULTIPLE 
MISSING 


Valid 

Cum 

Value 

Prequency 

Percent 

Percent 

Percent 

0 

A2A 

30.8 

3A.1 

3A.1 

1 

670 

A8.7 

53.9 

87.9 

2 

106 

7.1 

8.5 

96.5 

3 

AO 

2.9 

3.2 

99.7 

A 

3 

.2 

.2 

99.9 

8 

1 

.1 

.1 

100.0 

• 

1 

.1 

MISSING 

9 

131 

9.5 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases 


12AA 


Missing  Cases  132 


Don  t  Know  was  not  an  explicit  response  category  for  this  question,  nor 
was  this  a  critical  item.    The  one  case  of  Don't  Know  recorded  in  the 
frequencies  reflects  an  editor's  notation  upon  completing  an  inadvertent 
edit  of  a  non-critical  item.    Since  this  is  a  question  about  students' 
perceptions  which,  though  grounded  in  the  objective  world  need  not 
accurately  reflect  it,  there  is  ro  independent  criterion  for  judging  the 
strict  correctness  of  these  responses.    Given  the  level  of  awareness  of 
blacks  and  Hispanics  shown  by  1980  sophomores,  and  the  only  somewhat  lower 
nonresponse  levels  for  3A  and  3B  concerning  blacks  and  Hispanics— groups 
that  are  more  heavily  represented  in  the  eighth  grade  population  and  perhaps 
more  visible— the  9.5  percent  nonresponse  figure  for  this  item  seems  nr . 
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necessarily  indicative  of  item  wording  of  questionnaire  fc     t  problems. 
It  nay  be  asked  whether  an  explicit  Don't  Know  category  should  be  given  in 
the  base-year  version  of  the  question  for  all  three  subparts  (A,  B,  c).  The 
High  School  and  Beyond  versions  of  this  question  did  not  offer  a  Don't  Know 
option.  Insofar  as  this  question  is  a  trend  item,  useful  in  cross-cohort 
comparisons,  maximum  parallelism  to  the  High  School  and  Beyond  version  is 
desirable.    It  is  also  conceivable  that  some  students  would  find  it  easier 
to  answer  Don  t  Know  than  to  think  about  the  relative  proportions  of 
different  groups  present  in  the  eighth  grade  in  their  schools,  thus 
increasing  nonresponse  in  an  altered  version.  Thus,  despite  the 

£!T2tl2ly  hi* un°"re8P°nse  for  3C'  the  only  slightly  lesser  nonresponse 
rate  tor  3B,  and  the  fact  that  some  proportion  of  students  genuinely  will 
not  know  the  answer  to  the  question,  we  do  not  recommend  adding  a  Don't  Know 
option • 

Question  9  is  a  critical  item.    It  asks  if  the  student  receives  or  has 
received  special  services  for  any  of  several  special  conditions.    It  is  then 
broken  into  subparts,  two  of  which-C  (deafnes.)  and  G  (other  major  health 
problemz—have  nonresponse  of  five  percent  or  higher. 

Q9C  SPECIAL  SERVICES  FOR  DEAFNESS  Critical  Item 

Value  Label 

YES 
NO 
DK 

MULTIPLE 
MISSING 


Valid  Cases  1308 


Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

1 

10 

.7 

.8 

.8 

2 

1297 

94.3 

99.2 

99.9 

8 

1 

.1 

.1 

100.0 

• 

0 

.0 

MISSING' 

9 

68 

4.9 

MISSIKG 

TOTAL 

1376 

100.0 

100.0 

Missing  Cases  68 

Q9G  SPECIAL  SERVICE  FOR  OTHER  MAJOR  HEALTH  PROBLEM  Critical  Item 


Value  Label 

Value 

Frequency 

Percent 

Valid 
Percent 

Cum 
Percent 

YES 

NO 

DK 

MULTIPLE 
MISSING 

1 
2 
8 

• 

9 

91 
1206 
2 
0 
77 

6.6 
87.6 
.1 
0.0 
5.6 

7.0 
92.8 
.2 

MISSING 
MISSING 

7.0 
99.8 
100.0 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1299  Missing  Cases  77 

An  explicit  Don't  Know  option  was  not  provided.  However,  survey  teams 
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were  to edit  this  item,  and  a  Don't  Know,  Refusal,  or  a  meaningful  response 
should  have  been  obtained  by  the  editor.     Nonresponse  was  in  the  nature  of 
illegitimate  blanks,  which  ran  above  or  near  to  five  percent  on  both 
questions.    This  shows  the  need  for  some  improvement  in  the  Survey  Day  edit, 
part icuiarly^ since  it  is  not  clear  that  the  missing  data  represent  an 
unstated  Don  t  Know,  (it  seems  implausible  to  suppose,  for  example,  that  one 
student  out  of  twenty  simply  does  not  know  whether  he  or  she  has  ever 
received  special  services  for  the  problem  of  deafness.) 

Question  9G  offers  a  write-in  option  so  that  the  other  major  health 
problem  can  be  specified.    Examination  of  the  hardcopy  questionnaires 
nif*  *\  !!  4  few  (<  5  Percent)  cases  students  wrote  in  health  problems 

that  might  not  be  major  or  chronic  (for  example,  throat  infection)  but  that 
their  responses  were  normally  plausible.    They  ranged  from  rare  problems 
Uor  example,  brain  surgery  for  a  subarachnoid  cyst)  to  the  more  common 
Iheart  murmurs,  hormone  therapy  for  slow  growth),  with  over  half  the  cases 
having  to  do  with  either  allergy  or  asthma.    Indeed,  if  it  were  desired  to 
sort  out  the    other  health  problems"  in  a  way  that  would  produce  more 
specific  data,  this  could  best  be  done  through  the  addition  of  an 
asthma/severe  allergy  response  category. 

PARENTAL  OCCUPATION  SERIES 

The  parental  occupation  question  series  is  intended  to  be  parallel  to 
that  used  in  HLS-72  and  HS&B,  which  in  turn  drew  on  Census  occupation 
categories.      The  HS&B  version  of  the  occupation  question  has  been  very 
slightly  simplified  for  eighth  graders.    We  still  found,  in  the  iterative 
pretesting,  however,  that  these  categories  were  cumbersome  and  frustrating 
tor  eighth  graders  to  use,  and  it  was  sometimes  unclear  whether  the 
categories  were  being  used  accurately.  Earlier  in  this  report  (3.2.2)  in  the 
discussion  of  the  in-house  edit  of  the  student  questionnaire,  we  noted  that 
the  parental  occupation  question  registered  a  high  retrieval  rate,  a  high 
in-school  edit  error  rate,  and  a  high  nonresponse  rate.  Nevertheless,  the 
occupation  series  is  especially  important,  because  it,  along  with  the 

PaIeUefixedUC*ti0n  series»  £orn*  the  b»8i»  ^r  constructing  (as  in  NLS-72 
and  HS&B;  a  composite  socioeconomic  status  (SES)  variable.    SES,  in  turn,  is 
of  course  a  critical  independent  variable  for  the  analysis  of  educational 
and  career  outcomes.  Since  the  parent  questionnaire  contains  parallel 
occupation  and  education  items,  we  were  able  to  compare  student  and  parent 
reports  (3.2.7).    Quite  apart  from  the  issue  of  whether  scudents  or  parents 
are  better  sources  of  this  information,  it  is  clear  from  the  response 
frequencies  below  that  even  after  the  critical  item  edit,  considerable 
nonresponse  remained  in  the  student  Occupation  reports. 
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Q13A 


OCCUPATION  CATEGORY  OP  R'S  FATHER  Critical  lte« 


Value  Label 

CLERICAL 
CRAPTSPERSOM 
PARMER  FARM  MANAGER 
HOMBMAKER/ HOUSEWIFE 
LABORER 

manager/ admini strator 
military 
operative 
professional  1 
professional  2 
proprietor  or  owner 

PROTECTIVE  SERVICE 
SALES 

SCHOOL  TEACHER 

SERVICE 

TECHNICAL 

NEVER  WORKED 

REFUSED 

DK 

MULTIPLE 
MISSING 


Valid  Cases  1153 


Value  Frequency 


1 

35 

2 

181 

3 

10 

4 

10 

5 

87 

6 

178 

7 

32 

8 

140 

9 

83 

1U 

36 

11 

86 

26 

13 

63 

14 

7 

15 

17 

16 

40 

17 

2 

97 

4 

98 

116 

131 

99 

92 

TOTAL 

1376 

Missing  Cases 

223 

Valid  Cum 
Percent    Percent  Percent 


2.5 

3.0 

3.0 

13.2 

15.7 

18.7 

.7 

.9 

19.6 

.7 

.9 

20.5 

6.3 

7.5 

28.0 

12.9 

15.4 

43.5 

2.3 

2.8 

46.2 

10.2 

12.1 

58.4 

6.0 

7.2 

65.6 

2.6 

3.1 

68.7 

6.3 

7.5 

76.1 

1.9 

2.3 

78.4 

4.6 

5.5 

83.9 

.5 

.6 

84.5 

1.2 

1.5 

85.9 

2.9 

3.5 

89.4 

.1 

.2 

89.6 

.3 

.3 

89.9 

8.4 

10.1 

100.0 

9.5 

MISSING 

6.7 

MISSING 

100.0 

100.0 

97 
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Q13B  OCCUPATION  CATEGORY  OP  R'S  MOTHER  Critical  Itea 


Valid 

Cum 

Value  Label 

Value 

Frequency 

Percent 

Percent 

Perceni 

CLERICAL 

1 

244 

17.7 

20.3 

20.3 

CRAFTS PERSON 

2 

27 

2.0 

2.2 

22.5 

PARMER  FARM  MANAGER 

3 

8 

.6 

.7 

23.2 

HOMEMAKER/ HOUSEWIFE 

4 

308 

22.4 

75.6 

48., 'i 

LABORER 

5 

12 

.9 

1.0 

49.8 

MANAGER/ ADMINI STRATOR 

6 

90 

6.5 

7.5 

57.3 

OPERATIVE 

8 

35 

2.5 

2  9 

60.2 

PROFESSIONAL  * 

9 

112 

8.1 

9.3 

69.6 

PROFESSIONAL  2 

10 

13 

.9 

l.i 

70.6 

PROPRIETOR  OR  OWNER 

11 

35 

2.5 

2.9 

73.5 

PROTECTIVE  SBu/ICE 

12 

3 

.2 

.2 

73.8 

SALES 

13 

52 

3.8 

4.3 

78.1 

SCHOOL  TEACHER 

14 

62 

4  5 

0  J  .  J 

SERVICE 

15 

77 

5.6 

6.4 

89.7 

TECHNICAL 

16 

18 

1  i 

1  C 
1  •  J 

Q1  O 

NEVER  WORKED 

17 

21 

1.5 

1.7 

92.9 

REFUSED 

97 

3 

.2 

.2 

93.2 

DK 

98 

82 

6.0 

6.8 

100.0 

MULTIPLE 

111 

8.1 

MISSING 

MISSING 

99 

63 

4.6 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1202 

Missing  Cases  174 

For  paternal  occupation,  ncnresponse  totals  a  very  unhappily  high  24.6 
percent.    However,  only  6.7  perrent  of  that  owes  to  illegitimate  blanks — 
93.3  percent  cf  respondents  gave  an  answer  to  the  question,  although  this 
rate  reflects  in  part  the  retrieval  efforts  of  the  on-site  editor.  Even 
after  in-school  edit,  multiple  responses  ran  to  9.5  percent  of  the  total. 
Multiple  response  at  s>'ch  a  high  rate  indicates  strongly  that  respondents 
found  the  response  cat^ories  difficult  to  use.    (While  multiple  response  is 
generally  to  be  explained  in  terms  of  confusion  as  to  which  category  best 
applies  to  a  parent,  a  rare  exception  identified  in  hardcopy  edit  was  the 
case  of  a  parent  having  two  full-time  jobs.) 

Students  Jid  better — though  not  well—with  maternal  occupation. 
This  is  perhaps  owing  to  a  less  various*  female  participation  in  the 
labor  force  (over  40  percent  of  mothers  were  classified  as  homemakers 
*>r  clerical  workers).    The  overall  pattern,  however,  parallels  that 

>und  for  father's  occupation.    The  most  common  kind  of  nonresrjnse  was 
multiple  response  (8.1  percen*  ),  followed  by  Don't  Knows  (6  percent) 
and  finally  illegitimate  blanks  (4.6  percent).    When  this  level  of 
nonresponse  is  compared  to  High  School  and  Beyond  in  1980,  we  see  that 
US&B  sophomores  did  substantially  better  then  NELS:88  field  test  eighth 
graders  and  that  US&B  seniors  did  better  than  sophomores.    (On  paternal 
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occupation,  nonresponse  for  1980  seniors  was  12. 7  percent,  for  1980 
sophomores  15.6  percent,  and  for  1987  eighth  graders  24.6  percent.) 
Clearly,  occupational  knowledge  is  in  part  a  function  of  cognitive 
maturity  or  aga  and  many  students  are  not  good  reporters  of  parental 
occupation  data  in  early  adolescence. 

Of  equivalent  importance  in  constructing  an  SES  composite  variable  is 
parental  education.    Parental  education  items  pose  the  same  difficulty  as 
occupation  questions  when  asked  of  adolescents:    their  information  improves 
rapidly  oyer  time  but  is  not  necessarily  good  at  eighth  grade.    In  the  base 
year  of  High  School  and  Beyond,  the  paternal  education  item  generated  15.6 
percent  nonresponse  among  seniors  (10.5  percent  Don't  Know  and  2.9  percent 
mltiple  response)  and  23.2  percent  among  sophomores  (including  16.9  percent 
Don't  Know  and  four  percent  imiltiple  response).    The  year  17  essess*?i.t  of 
HAEP  solicited  ^ata  from  27,668  seventh  graders  and  39,572  eleventh  graders. 
It  too  illustrates  the  striking  variation  in  parental  education  reports  by 
age.  The  composite  parent  education  measure  depends  on  having  a  report  on  at 
least  one  parent.    This  condition  is  fulfilled  for  all  but  4.6  percent  of 
the  eleventh  graders  but  is  not  satisfied  for  15.3  percent  of  seventh 
graders.    Mother's  education  elicited  a  Dou't  Know  or  missing  response  for 
6.9  percent  of  11th  graders  and  20.4  percent  of  7th  graders;  father's 
education  shows  10.5  percent  nonresponse  for  eleventh  graders  but  20.5 
percent  nonresponse  for  seventh  graders.    These  data  underscore  the  need  to 
ask  educational  attainment  information  aoout  both  parents,  since  missing 
data  for  each  parent  is  much  higher  than  the  rate  of  missing  data  for  one 
parent  or  the  other.  In  the  light  of  the  NAEP  and  US&B  experience,  the 
response  frequencies  below  (which  reflect  no  on-site  retrieval;  this  was  not 
a  critical  item)  are  unsurprising. 

PARENTAL  EDUCATION  SERIES 

Q14A  HIGHEST  LEVEL  OF  ED  R'S  FATHER  COMPLETED 


Value  Label 

Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

<  H.S.  DIPLOMA 

1 

122 

8.9 

10.2 

10.2 

HIGH.  SCHOOL  DIPLOMA 

2 

285 

20.7 

23.9 

34.1 

VOC, TRADE, BUS, <  2YRS 

3 

23 

1.7 

1.9 

36.1 

VOC    1ADE,BUS,>  2YRS 

4 

V, 

1.7 

2.0 

38.1 

COLL  PROG  <  2YRS 

5 

60 

4.4 

5.0 

43.1 

COLL  PROG  2YRS  OR  > 

6 

85 

6.2 

7.1 

50.3 

FINISHED  COLLEGE 

7 

163 

11.8 

13.7 

63.9 

MASTERS  DEGREE 

8 

88 

6.4 

7.4 

71.3 

PH.D  OR  M.D. 

9 

48 

3.5 

4.0 

75.3 

DK 

98 

294 

U.4 

24.7 

100.0 

MULT  I  >LE 

92 

7 

MISS" 

MISSING 

99 

92 

b.7 

MISSxNG 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1192 

Missing  Cases  184 

99 
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Q14B  HI CHEST  LEVEL  OF  ED  R'S  MOTHER  COMPLETED 


Value  Ubel 

Valid 

Cum 

Value 

Frequency 

Perc ent 

rci vent 

Do  v*^  on  t* 

rc  it  v  en  i 

<  H.3.  DIPLOMA 

1 

125 

9.1 

10  3 

IP  3 

HIGH  SCHOOL  DIPLOMA 

2 

360 

26.2 

29.7 

AO  0 

VOC, TRADE, BUS, <  2YRS 

3 

36 

2.6 

3.0 

43.0 

Wu,  loJUJc,  ouo,  >  2YRS 

4 

35 

2.5 

2.9 

45.9 

COLL  PROG  <  2YRS 

5 

59 

4.3 

4.9 

50.7 

OOLL  PROG  2YRS  OR  > 

6 

97 

7.0 

8.0 

58.7 

PINISHBD  COLLEGE 

7 

162 

11.8 

13.4 

72.1 

MASTERS  DECREE 

8 

59 

4.3 

4.9 

77.0 

PH.D  OR  M.D. 

9 

25 

1.8 

2.1 

79.0 

DK 

98 

254 

18.5 

21.0 

100.0 

MULTIPLE 

99 

7.2 

MISSING 

MISSING 

99 

65 

4.8 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Caseg  1212 

Missing  Cases  164 

Thus  we  tee  34.8  percent  nonresponse  on  father's  education  and  30.5 
percent  on  moth'  's  education,    A  crosstabulation  of  14A  by  MB  shows  that 
in  322  cares  (23  percent)  we  have  education  data  on  neither  parent.    It  is 
interesting  to  note  the  nature  of  the  nonresponse.    For  both  paternal  and 
maternal  education,  more  nonresponse  falls  into  the  Don't  Know  category  than 
into  multiple  response  and  illegitimate  blanks  combined.  Though 
illegitimate  blanks  are  the  smallest  part  of  the  nonresponse  problem,  making 
this  item  critical  might  reduce  the  number  of  illegitimate  blanks — unless 
these  are  predominantly  hidden  Don't  Knows.    An  in-school  edit  could  also 
J _ssen  the  number  of  multiple  responses — although  machine-cleaning  can 
readily  give  multiple  answers  univocal  determination  in  a  hierarchically 
organized  question  such  as  this  one,  by  systematically  selecting  the  highest 
category  marked.    Multiple  response  may  also  be  lowered  by  collapsing  some 
of  the  categories  which  utilize  fine  distinctions  of  which  students  are 
unlikely  to  be  cognizant.    Many  students  will  not  know  whether  their  mother 
or  father  completed  less  than  two  years  of  vocational,  trade,  or  business 
school,  or  whether  the  parent  completed  two  years  or  more  of  vocational, 
trade,  or  business  school,    Still,  the  high  rates  of  nonresponse  on  the 
paren^l  occupation  and  education  questions  constitute  a  significant 
obstacle  to  creation  of  a  reliable  and  valid  composite  SES  variable.  In 
addition  to  the  matter  of  nonresponse,  a  further  question  is  the  quality  of 
the  responses  that  were  given.    This  issue  will  be  addressed  in  3.2.7,  where 
we  compare  data  provided  by  students  with  the  information  supplied  by  their 
parents. 

Question  18  inquires  into  parental  involvement  in  the  school.    It  has  four 
subparts.    Part  A  is  concerned  with    parental  participation  in  school  meetings. 
Part  B  inquires  about  parental  conversations  with  teachers  or  counselors.    Part  C 
asks  about  visits  to  classes,  and  Part  D  about  attendance  at  a  school  event  where 
the  student  participated.    Parts  A,  B  and  C  were  high  nonresponse  items. 
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Q18A  HAVE  R'S  PARENTS  ATTENDED  A  SCH  MEETING 


Value  Label 
YES 
NO 
DK 

MISSING 


Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

1 

704 

51.2 

52.6 

52.6 

2 

SOS 

36.7 

37.7 

90.4 

8 

129 

9.4 

9.6 

100.0 

9 

38 

2.8 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1338 


Missing  Cases  38 


QI8B  HAVE  R'S  PARENTS  SPOKEN  TO  R'S  TEACHER 

Value  Label 


YES 

NO 

DK 

MISSING 


Valid  Cases 


1353 


Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

1 

?91 

57.5 

58.5 

58.5 

2 

420 

30.5 

31.0 

89.5 

3 

142 

10.3 

10.5 

100.0 

9 

23 

1.7 

MISSING 

~OTAL 

137* 

100.0 

100.0 

Missing  Cases  23 


Q18C  VB  R'S  7ARENTS  VISITED  THE  CLASSROOM 


Value  L. 

Valid 

Cum 

Vaiue 

Frequency 

Percent 

Percent 

Percen 

YiJS 

1 

414 

30.1 

31.0 

31.0 

m 

2 

841 

61.1 

63.0 

94.0 

DK 

8 

80 

5.8 

6.0 

100.0 

MISSING 

9 

41 

3.0 

MISCING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1335  Missing  Cases  41 


In  all  three  cases,  nonresponse  is  concentrated  in  the  Don't  Know 
category.    It  does  not  seem  that  Don't  Know  is  beirg  used  as  an  "easy  out" — 
the  question  is  not  overly  demanding,  and  there  is  $cod  variance  in  the  use 
of  this  option  from  subpart  to  subpart  (the  Don't  Know  responses  in  question 
18  ranges  from  1.3  percent  in  18D  to  10.3  percent  in  18B).    The  Don't  Know 
rates  also  see^  perfectly  plausible,  given  the  ntture  of  the  question. 
Finally,  i:  should  be  noted  that  the  purpose  of  the  question  is  as  much  or 
more  to  probe  student  perceptions  as  to  ascertain  objective  facts  (parent 

101 


140 


report!  of  parental  behavior  are  likely  to  be  far  more  accurate).    Prom  this 
perspective,  the  Don't  Know  responses  are  an  important-  Jatum  rather  than  a 
nonresponse  problem.    We  recommend  no  changes  in  item  wording  or  in 
questionnaire  format  in  connection  with  question  18. 

Question  23B  is  a  modification  of  a  High  School  and  Beyond  item  (23A). 
While  23B  asks  about  television  viewing  on  weekends  and  is  a  problematic 
variable  (8.9  percent  nonresponse),  23A  asks  abouc  television  viewing  on 
weekdays  and  is  unproblematic  (4.5  percent  nonresponse).  It  is  difficult  to 
know  in  what  way  the  concept  of  a  weekend  differs  from  the  concept  of  a 
weekday  such  that  students  find  it  harder  to  respond  to  the  one  case  than 
the  other,    lior  is  this  difference  readily  attributable  to  format,  since  the 
second  element  formed  a  second  column  to  be  answered  in  precisely  the  same 
way  as  the  first.  In  other  instanr-s  in  which  this  format  was  used  (cf. 
question  27)  we  see  no  response  advantage  for  the  first  element.  However, 
it  may  be  that  a  number  of  students  completed  part  A  and  assumed  they  were 
finished  with  the  question— that ,  in  effect,  the  question  was  disjunctive,  a 
case  of  answer  either  A  or  B,  analogous  to  the  "Circle  One"  options  offered 
in  other  items.    In  addition  to  the  separate  instruction  "Mark  One  Oval 
Below"  attached  to  each  half  of  the  question,  a  general  instruction— "Answer 
Both  A  and  B  below"  should  be  added.    Also,  the  designation  HOURS  PER  DAY  in 
the  question  should  be  printed  in  bold,  so  that  no  confusion  can  arise  as  to 
whether  viewing  time  for  Saturday  and  Sunday  should  be  summed  or  averaged* 

Q23B  HOW  MANY  HOURS  ON  WEEKENDS  R  WATCHES  TV 


Value  Label  Value 

DO  NOT  WATHI  TV  0 
>  THAN  1  HOUR  A  DAY  1 

1-  2  HOURS  2 

2-  3  HOURS  3 

3-  4  HOURS  4 

4-  5  HOURS  5 
OVER  5  HOURS  A  DAY  6 

. 

TOTAL 

Valid  Cases       1234  Missing  ( 


Valid  Cum 
Frequency    Percent    Percent  Percent 


33 

2.4 

2.6 

2.6 

63 

4.6 

5.0 

7.7 

125 

9.1 

10.0 

17.6 

206 

15.0 

16.4 

34.1 

237 

17.2 

18.9 

53.0 

210 

15.3 

16.7 

69.7 

380 

27.6 

30.3 

100.0 

122 

8.9 

MISSING 

1376       100.0  100.0 


Question  27  it  taken  from  High  School  and  Beyond  and  NLS-72  and  asks 
how  far  in  school  the  respondent  thinks  his  parents  would  like  him  to  go. 
Since  the  purpose  of  this  question  is  to  elicit  the  student's  perceptions, 
and  it  is  of  interest  to  know  those  cases  ?n  which  parents  have  not  made 
their  aspirations  for  their  children  known  to  them,  a  high  rate  of 
legitimate  nonresponse— Don't  Know— would  not  in  itself  be  disturbing  for 
this  question.    However,  the  response  frequencies  show— particularly  for  the 
father  (27*)— a  disturbing  number  of  illegitimate  blanks. 
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Q27A 


HOW  PAR  IN  SCH  DOES  R'S  FATHER  WANT  R  TO  GO 


Value  Label 

Value 

WILL  NOT  FINISH  H.S 

1 

GRADUATE  PROM  H.S 

2 

VOC/TRADB/ BUSINESS 

3 

ATTEND  COLLEGE 

4 

GRAD  PROM  COLLEGE 

5 

HIGHER  AFTER  COLLEGE 

6 

DK 

8 

MULTIPLE 

• 

KISSING 

9 

TOTAL 

Valid 


Valid  Cases 


1159 


8 
46 
46 
85 
492 
342 
140 
49 
168 


Missing  Cases  217 


Cum 
Percent 


.6 

.7 

.7 

3.3 

4.0 

4.7 

3.3 

4.0 

8.6 

6.2 

7.3 

16.0 

35.8 

42.5 

58.4 

24.9 

29.5 

37.9 

10.2 

12.1 

100.0 

3.f 

MISSING 

12.2 

MISSING 

100.0 

100.0 

Q27B 


HOW  PAR  IN  SCH  DOES  R'S  MOTHER  WANT  R  TO  GO 


Value  Label 

Value 

Freq jency 

Percent 

WILL  NOT  FINISH  H.S 

I 

10 

.7 

GRADUATE  PROM  H.S 

2 

44 

3.2 

VOC/TRADB/ BUSINESS 

3 

47 

3.4 

ATTEND  COLLEGE 

4 

99 

7.2 

GRAD  PROM  COLLEGE 

5 

564 

41.0 

HIGHER  AFTER  COLLEGE 

6 

380 

27.6 

DK 

8 

122 

8.9 

MULTIPLE 

• 

58 

4.2 

MISSING 

9 

52 

3.8 

TOTAL 

1376 

100.0 

Valid  Cases  1266 

Missing  Cases  110 

Valid 
Percent 

.8 
3.5 
3.7 
7.8 
44.5 
30.0 
9.6 
MISSING 
MISSING 


Cum 
Percent 

.8 
4.3 
8.0 
'5.8 
t>0.3 
90.4 
100.0 


High  School  and  Beyond  asked  only  about  the  mother's  aspirations  for 
the  child's  educational  achievement,  not  the  father's.  Nonresponse  for  1980 
sophomores  was  25.5  percent,  including  18  percent  Don't  Know.    For  1980 
seniors  nonresponse  was  20.4  percent  (with  16.4  percent  Don't  Know).  For 
1987  eighth  graders,  nonresponse  was  16.9  percent  on  the  mother's 
aspirations  item  (with  8.9  percent  Don't  Know)— a  much  lower  rate  of 
nonresponse  than  in  HS&B.    However,  nonresponse  on  the  father's  aspirations 
question  was  higher  than  for  the  maternal  aspirations  question,  at  26 
percent,  with  10.2  percent  legitimate  nonresponse  (Don't  Know).    It  is  not 
clear  why  there  are  so  many  more  illegitimate  blanks  on  the  paternal 
aspirations  question  (triple  the  number  for  the  mother,  though 
a  Don't  Know  option  was  available).    If  certain  questions  that  are  now 
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subject  to  in-school  edit  are  dropped  from  the  base  year  student 
questionnaire  (for  example,  the  parental  occupation  and  education  questions) 
this  question  sight  be  considered  a  candidate  for  in-school  edit.  Multiple 
response  was  actually  greater  in  the  mother-  than  the  father-targeted 
question  (4.2  versus  3.6  percert).    Given  the  hierarchical  order  of  response 
categories,  multiple  response  can  be  successfully  treated  by  recognizing  as 
valid  only  the  highest  category  named. 

Question  28  should  be  compared  to  locator  question  13  (What  kind  of 
school  is  it:    General;  College  preparatory;  Trade  or  Vocational;  Other). 
In  the  earlier  question  we  found  considerable  nonresponse  and  evidence  of 
confusion  us  to  the  meaning  of  the  response  options.    In  question  28,  we  see 
high  nonresponse  as  students  confront  a  similar  set  of  labels,  this  time  in 
connection  with  program  type. 


Q28  WHICH  H.S  PROGRAMS  WILL  YOU  ENROLL  IN 


Valid 

Cum 

Value  Label 

Value  Pi 

;uency 

Percent 

Percent 

P'-rcent 

ACADEMIC /COLL  PREP 

1 

458 

33.3 

34.4 

34.4 

VOCATIONAL  (TRADE) 

2 

94 

6.8 

7.1 

41.4 

GENERAL 

3 

242 

17.6 

18.2 

59.6 

OTHER 

4 

157 

11.4 

11.8 

71.3 

DK 

8 

382 

27.8 

28.7 

100.0 

MULTIPLE 

. 

27 

2.0 

MISSING 

MISSING 

9 

16 

1.2 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1333 

Missing  Cases 

43 

The  number  of  illegitimate  blanks  is  quite  small,  at  just  over  one 
percent,  and  multiple  responses  stand  at  two  percent.    Nonresponse  is 
heavily  concentrated  in  the  Don't  Know  category.  What  is  important  here  is 
to  be  able  to  be  absolutely  certain  that  respondents  who  choose  the  Don't 
Know  response  in  fact  lack  knowledge  of  what  program  they  will  enroll  in~ 
and  that  they  have  not  chosen  Don't  Know  simply  because  an  unfamiliar  label 
is  being  used  to  describe  program  type.    Thus  the  recommendation  for  this 
item  is  much  the  same  as  that  for  locator  question  13:    we  will  try  to  gloss 
program  type  with  alternative,  and  we  hope  more  familiar  descriptors.  If 
the  Dor/t  Know  category  continues  to  be  heavily  utilized,  there  probably  is 
a  genuine  lack  of  knowledge  about  program  type.    The  questionnaire  data 
themselves  give  some  reason  to  suppose  that  high  school  program  knowledge  is 
not  necessarily  w'dely  disseminated  in  the  field  test  schools.    Question  31 
shows  that  less  than  a  quarter  of  the  sample  has  received  vocational 
education  information.  Over  half  had  had  no  conversations  with  their 
teachers  about  high  school  (29D).    Note  too  that  in  question  30A,  which  has 
only  2.3  percent  nonresponse,  62.5  percent  of  this  sample  indicate  that  they 
have  not  talked  with  a  guidance  counselor  about  high  schools  and  high  school 
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program,  and  only  18  percent  have  talked  to  a  counselor  about  hijh  school- 
two  or  nore  times.    A  parallel  item  about  planning  high  school  program  (29C) 
will  be  analysed  below  for  nonresponse.    It  too  suggests  little  contacc  with 
counselors  in  regard  to  planning  for  high  school. 

Question  29  asks  how  often  the  respondent  has  talked  to  parents, 
counselors,  teachers,  or  relatives  and  friends  about  planning  a  program  for 
high  school.    One  element~29Cf  pertaining  to  talks  with  guidance 
counselors—had  high  nonresponse. 


Q29C 


HOW  OFTEN  R  TALK  W/A  GUIDANCE  COUNSELOR 


Value  Label 

HOT  AT  ALL 
ONCE  OR  TWICE 
THREE  OR  MORE  TIMES 
MISSING 


Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

0 

919 

66.8 

72.7 

72.7 

1 

272 

19.8 

21.5 

94.2 

2 

73 

5.3 

5.8 

100.0 

9 

112 

8.1 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases 


1264 


Missing  Cases  112 


It  is  not  clear  why  illegitimate  blanks  ran  to  8.1  percent  in  this 
question.    Were  there  a  format  problem,  one  would  expected  parts  A,  Bf  D  and 
E  tc  be  plagued  with  high  nonresponse  but  none  are.    If  the  problem  is  one 
of  knowledge — of  not  remembering,  and  not  having  a  Don't  Know  category— it 
is  puztling  to  consider  that  30A,  with  essentially  the  same  content,  has 
only  2.3  percent  nonresponse.    The  response  frequencies  offer  no  clear 
suggestion  as  to  why  a  comparatively  high  number  of  illr gitimaie  blanks 
should  appear  on  question  29C. 

Question  33  asks  whether  the  respond2nt  has  taken  any  special  test  that 
would  indicate  aptitude  for  a  particular  career  or  job.      Nearly  a  quarter 
of  respondents  do  not  know  whether  they  have  done  so  or  not. 

Q33  DID  R  TAKE  TEST  INDICATING  APTITUDE 


Valid 

Cum 

Value  Label 

Value 

Frequency 

Percent 

Percent 

Percent 

YES 

1 

288 

20.9 

21.7 

21.7 

NO 

2 

699 

50.8 

52.7 

74.4 

DK 

8 

340 

24.7 

25.6 

100.0 

MISSING 

9 

49 

3.6 

MISSING 

TOTAL 

J  376 

100.0 

100.0 

Valid  Cases  li27 

Missing  Cases  49 
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Since  it  was  realised  that  the  meaning  of  aptitude  might  not  be  clear 
to  all  eighth  graders,  it  was  explained  parenthetically  in  the  question  as 
"potential  talent  or  capability"— but  even  to  know  what  aptitude  is  is  not 
necessarily  to  have  a  basis  for  being  certain  whether  one  has  taken  an 
aptitude  test.    Perhaps  named  examples  of  the  most  common  aptitude  tests 
could  be  given  here.    It  is  not  clear,  however,  that  all  students  will  know 
by  name  the  tests  that  they  have  been  given*    It  is  also  possible  that 
removing  the  Don't  Know  option  would  force  some  respondents  into  making  a 
fairly  reliable  educated  guess  about  whether  tests  they  had  taken  were  or 
were  not  aptitude  batteries.    This,  however,  would  certainly  increase  the 
number  cf  illegitimate  blanks.    We  recommend  that  the  major  aptitude  tests 
that  an  eighth  grader  might  be  exposed  to  be  specifically  named  as  examples. 
This  will  increase  the  clarity  of  the  question.    We  strongly  suspect, 
however,  that  while  teachers,  counselors,  and  principals  could  supply  such 
information  without  difficulty,  there  will  be  many  eighth  graders  vho  will 
not  be  able  to  answer  this  question,  even  in  modified  form. 

Question  34  is  taken  from  High  School  and  Beyond  and  is  an  important 
question  for  longitudinal  analysis.  We  know  that  occupational  expectations 
will  be  more  developed  later  in  adolescence,  and  that  eighth  graders  are 
likely  to  feel  more  uncertainty  in  this  matter  than  will  tenth  or  twelfth 
graders.    Thus  a  high  Don't  Know  rate  is  not  necessarily  damaging  for  this 
baseline  question,  but  multiple  response  and  illegitimate  blanks  constitute 
a  genuine  nonresponse  problem. 


Q34  WHAT  KIND  0?  WORK  R  WILL  BE  DOING  AT  30 


Valid  Cum 

Value  Label  Value    Frequency    Percent    Percent  Percent 


CRAFTPER SON/OPERATOR 

1 

42 

3.1 

3.3 

3.3 

FARMER /FARM  MANAGER 

2 

5 

.4 

.4 

3.7 

HOUSEWIFE/HOMEMAKER 

3 

13 

.9 

1.0 

4.7 

LABORER/ FARM  WORKER 

4 

7 

.5 

.6 

5.3 

MI LI /POLICE/SECURITY 

5 

103 

7.5 

8.1 

13.4 

BUSINESS /MANAGERIAL 

6 

350 

25.4 

27.7 

41.1 

OWNER 

7 

67 

4.9 

5.3 

46.4 

TECHNICAL 

8 

90 

6.5 

7.1 

53.5 

SALESPERSON/CLERICAL 

9 

31 

2.4 

2.6 

56.1 

SCIENCE/ ENGINEERING 

10 

77 

5.6 

6.1 

62.2 

SERVICE  WORKER 

11 

27 

2.0 

2.1 

64.3 

OTHER 

12 

282 

20.5 

22.3 

86.6 

NOT  WORKING 

13 

1 

.1 

.1 

86.7 

DK 

98 

168 

12.2 

13.3 

100.0 

MULTIPLE 

. 

80 

5.8 

MISSING 

MISSING 

99 

31 

2.3 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1265 

Missing  Cases 

111 

106 
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In  fact  wt  set  that  while  there  is  20  percent  nonresponse  overall,  12 
percent  of  that  ii  Don't  Know.    Multiple  responses  are  the  principal 
illegitimate  nonresponse  problem.    Additional  emphasis  should  be  put  in  the 
question  instructions  to  choose  only  one  occupational  category.  Students 
should  be  explicitly  told  that  in  the  event  of  uncertainty,  they  should 
choose  the  occupation  category  in  which  they  are  most  likely  to  be  employed 
at  age  30,  and  that  they  should  not  indicate  more  than  one  response. 

ABILITY  GROUP  SERIES 

One  of  the  major  issues  to  be  explored  by  NELS:88  is  the  dynamics  of 
tracking.    Ability  grouping  information  is  sought  from  both  the  student,  and 
two  of  the  student's  teachers  (representing  two  of  the  four  tested 
curriculum  areas).    Question  43  asks  students  what  ability  group  they  are  in 
for  each  of  the  four  subject  areas  covered  by  the  cognitive  test  battery- 
mathematics,  English,  science  and  social  studies.    Ability  grouping  is  a 
feature  of  some  subject  areas  more  than  others.    Mathematics  tends  to  be  the 
most  heavily  tracked  subject,  Social  Studies  perhapt  the  least.  We 
anticipated  that  there  might  be  more  Don't  Know  response  in  subjects  in 
which  ability  grouping  is  less  explicit  or  common. 

Q43A  WHAT  ABILITY  GROUP  IS  R  FOR  MATHEMATICS  Critical  Item 


Valid 

Cum 

Value  Label 

Value 

Frequency 

Percent 

Percent 

Percent 

HIGH 

1 

430 

31.3 

31.5 

31.5 

MIDDLE 

2 

500 

36.3 

36.6 

68.1 

LOU 

3 

107 

7.8 

7.8 

76.0 

WE  AREN'T  GROUPED 

4 

252 

18.3 

18.5 

94.4 

REFUSED 

7 

1 

.1 

.1 

94.5 

DK 

8 

75 

5.5 

5.5 

100.0 

. 

4 

.3 

MISSING 

MISSING 

9 

7 

.5 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1365 

Missing  Cases  11 

Q43B           WHAT  ABILITY 

GROUP  IS  R 

FOR  SCIENCE 

Critical 

Item 

Valid 

Cum 

Value  Label 

Value 

Frequency 

Percent 

Percent 

Percent 

HIGH 

1 

289 

21.0 

21.2 

21.2 

MIDDLE 

2 

517 

37.6 

38.0 

59.2 

LOU 

3 

67 

4.9 

4.9 

64.1 

WE  AREN'T  GROUPED 

4 

397 

28.9 

29.2 

93.3 

REFUSED 

7 

1 

.1 

.1 

93.4 

DK 

8 

90 

6.5 

6.6 

100.0 

MULTIPLE 

* 

6 

.4 

MISSING 

MISSING 

9 

9 

.7 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1361 

ERIC 


Missing  Cases  15 
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Q43C  WHAT  ABILITY  GROUP  IS  R  FOR  ENGLISH  Critical  I  tea 


Valid 

Cum 

Value  Label 

Value 

Frequency 

Percent 

Percent 

Percent 

HIGH 

1 

335 

24.3 

24.5 

24.5 

flil/UlaC 

2 

510 

37.1 

37.4 

61.9 

LOU 

3 

90 

6.5 

6.6 

68.5 

WE  aren't  grouped 

4 

353 

25.7 

25.9 

94.4 

REFUSED 

7 

1 

.1 

.1 

94.4 

DK 

8 

76 

5.5 

5.6 

100.0 

MULTIPLE 

• 

4 

.3 

MISSING 

MISSING 

9 

7 

.5 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1365 

Missing  Cases  11 

Q43D 


WHAT  ABILITY  GROUP  FOR  SOCIAL  STUDIES  Critical  I  tea 


Value  Label 

HIGH 

MIDDLE 

LOW 

WE  AREN'T  GROUPED 

REFUSED 

DK 

MULTIPLE 
MISSING 


Valid  Cases 


363 


Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

1 

291 

21.1 

21.3 

21.3 

2 

499 

36.3 

36.6 

58.0 

3 

72 

5.2 

5.3 

63.2 

4 

405 

29.4 

29.7 

93.0 

7 

1 

.1 

.1 

93.0 

8 

95 

6.9 

7.0 

100.0 

• 

4 

.3 

MISSING 

9 

9 

.7 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Missing  Cases  !3 

Nonresponse  for  these  critical  items  varied  within  a  narrow  range,  from 
a  high  of  7  9  percent  for  Social  Studies  to  a  low  of  6.3  percent  for 
Mathematics.    Illegitimate  nonresponse— multiple  response  and  blanks— ranges 
from  a  high  of  1.1  percent  for  science  to  a  low  of  .8  percent  for 
mathematics  and  English.    If  the  Don't  Know  responses  largely  reflect  «  true 
lack  of  knowledge  about  the  object  of  the  question,  nonresponse  is  already 
exceptionally  low  and  probably  can  at  best  be  marginally  improved  upon. 

ATTITUDES  TOWARD  SCHOOL  SUBJECTS  SERIES  (Q.  49-52) 

Questions  49  through  52  are  cponsored  by  the  National  Science 
Foundation.    They  attempt  to  assess  student  attitudes  toward  mathematics  and 
science  and,  as  a  point  of  comparison,  English  and  social  studies.    Thus  all 
subjects  in  the  cognitive  test  battery  are  covered,  with  items  that  inquire 
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into  whether  the  respondent  finds  the  subject  enjoyable,  usc-tul.  a  class 
that  can  be  looked  forward  to,  or  a  class  in  which  the  respondent  is  afraid 
to  raise  questions*    Thus  there  are  sixteen  data  elements  in  the  question 
series,  covering  four  attitude  areas  for  each  of  the  four  subjects. 


Q49A  MATHEMATICS  CLASS  IS  USUALLY  PUN 


Valid 

Cum 

Value  Label 

Value 

Frequency 

Percent 

Percent 

Percent 

AGREE 

1 

805 

58.5 

60.6 

60.6 

DISAGREE 

2 

459 

33.4 

34.5 

95.1 

OK 

8 

6e 

4.7 

4.9 

100.0 

MISSING 

9 

47 

3.4 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases  1329 

Missing  Cases  47 

Q49B          I  USUALLY 

LOOK  FORWARD  TO  MATH  CLASS 

Valid 

Cum 

Value  Label 

Value 

Frequency 

Percent 

Percent 

Percent 

AGREE 

1 

595 

43.2 

44.7 

44.7 

DISAGREE 

2 

639 

46.4 

48.0 

92.8 

DK 

8 

96 

7.0 

7.2 

100.0 

MISSING 

9 

46 

3.3 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1330  Missing  Cases  46 


Q49D  MATH  WILL  BE  USEFUL  IN  MY  FUTURE 


Valid  Cum 

Value  Label  Value    Frequency    Percent    Percent  Percent 


AGREE 

1 

1107 

80.5 

83.2 

83.2 

DISAGREE 

2 

114 

8.3 

8.6 

91.7 

DK 

8 

110 

8.0 

8.3 

100.0 

MISSING 

9 

45 

3.3 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1331  Missing  Cases  45 
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ENGLISH  CLASS  IS  USUALLY  PUN 


Value  Label 

Value 

Frequency 

Percent 

Valid 
Percent 

Cum 
Percent 

AGREE 

DISAGREE 

OK 

MISSING 

1 
2 
8 
9 

766 
503 
62 
45 

55.7 
36.6 
4.5 
3.3 

57.6 
37.8 
4.7 
MISSING 

57.6 
95.3 
100.0 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases 

1331 

Missing  Cases  45 

Q50D           ENGLISH  WILL  BE  USEFUL  IN  MY  FUTURE 

Value  Label 

Value 

Frequency 

Percent 

Valid 
Percent 

Cum 
Percent 

AGREE 

DISAGREE 

DK 

MISSING 

1 
2 
8 
9 

1025 
175 
131 
45 

74.5 
12.7 
9.5 
3.3 

77.0 
13.1 
9.8 
MISSING 

77.0 
90.2 
100.0 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases 

1331 

Missing  Cases  45 

QS1A          SOCIAL  STUDIES 

CLASS  IS 

USUALLY  FUN 

Value  Label 

Value 

Frequency 

Percent 

Valid 
Percent 

Cum 
Percent 

AGREE 

DISAGREE 

DK 

MISSING 

1 
2 
8 
9 

751 
512 
60 
53 

54.6 
37.2 
4.4 

56.8 
38.7 
4.5 
MISSING 

56.8 
95.5 
100.0 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1323  Missing  Cases  53 
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Q5 IB  I  USUALLY  LOOK  FORWARD  TO  SOCIAL  STUDIES 


Value  Label 

Value 

Frequency 

Percent 

Valid 
Percent 

Cum 
Percent 

AGREE 

DISAGREE 

DK 

MISSING 

1 
2 
8 
9 

623 
635 
64 
54 

45.3 
46.1 
4.7 
3.9 

47.1 
48.0 
4.8 
MISSING 

47.1 
95.2 
100.0 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases 

1322 

Missing  Cases  54 

Q51D  SOC. 

STUDIES 

WILL  BE  USEFUL  IN  MY  FUTURE 

Value  Label 

Value 

Frequency 

Percent 

Valid 
Percent 

Cum 
Percent 

AGREE 

DISAGREE 

DK 

MISSING 

1 
2 
8 
9 

671 
421 
228 
56 

48.8 
30.6 
16.6 
4.1 

50.8 
31.9 
17.3 
MISSING 

50.8 
82.7 
100.0 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1320  Missing  Cases  56 


Q52D  SCIENCE  WILL  BE  USEFUL  IN  MY  FUTURE 


Valid 

Cum 

Value  Label 

Value 

Frequency 

Percent 

Percent 

Percent 

AGREE 

1 

799 

58.1 

60.2 

60.2 

DISAGREE 

2 

326 

23.7 

24.5 

84.7 

DK 

8 

203 

14.8 

15.3 

100.0 

MISSING 

9 

48 

3.5 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1328  Missing  Cases  48 

Nine  of  the  sixteen  data  elements  in  the  series  have  high  (8  percent  or 
above)  nonresponse.      There  is  something  of  a  pattern  to  this  nonresponsea  For 
all  four  subject  areas,  element  D— -which  asks  if  the  subject  will  be  useful  to 
the  student  in  the  future — is  problematic.    However,  for  none  of  the  four 
subjects  is  element  C — inquiring  whether  the  student  is  afraid  to  ask  questions 
in  class — problematic.    In  addition*  student  attitudes  seem  more  crystallized 
in  some  subject  areas  than  others.    Three  of  the  four  data  elements  are 
problematic  for  mathematics  and  social  studies,  but  only  one  for  science. 
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Nonresponse  in  this  series  ranges  from  a  high  of  20.6  percent  (of  which 
16.6  percent  is  Donft  Know)  on  5iD  (Social  Studies  will  be  useful  for  my 
future)  to  five  percent  for  52A  (Science  class  is  usually  fun).    In  fact, 
the  four  highest  nonresponse  items  are  the  D  elements  for  each  of  the  four 
inbjects,  and  the  nonresponse  is  predominant lw  Don't  Know*    Thus  in  terms  of 
juuging  the  fur  re  utility  of  the  subject  matter,  nonresponse  was  20.6 
percent  for  social  studies,  18.3  percent  for  science,  12.7  percent  for 
English  end  11.3  percent  for  math. 

Me  do  not  see  any  evidence  of  lack  of  clarity  in  this  question  secies. 
Illegitimate  blanks  are  in  the  3  percent  range.    Don't  Knows  are  high  but 
there  is  considerable  variation  from  question  to  question  in  the  extent  to 
which  thi    jption  is  utilized  (from  1.8  percent  on  49C  to  16.6  percent  on 
51D).    This  constitutes  srrong  evidence  that  students  a*e  closely  reading 
the  Questions.    Nonresponse  in  this  series  would  appear  to  reflect  the  fact 
thaw  student  attitudes  toward  their  school  subjects  are  in  a  state  of  flux 
or  crystallization  in  early  adolescence.    It  is  this  rather  than 
difficulties  with  questionnaire  format  or  item  wording  that  would  seem  to 
account  for  most  of  the  nonresponse  recorded  here. 

feARLY  EDUCATIONAL  EXPEFIENCB  SERIES 

This  series  inquire    into  the  early  educational  exper^-.ce  of  the 
student,  asking  whether  kindergarten,  day  care,  nursery  school,  Head  Start, 
or  extended  day  school  were  attended.    These  questions  are  also  asked  in  the 
parent  questionnaire— see  3.2  7  for  a  comparison  of  student  and  parent 
responses.    Of  the  five  elements  in  the  series,  all  are  problematic  except 
for  the  first,  kindergarten  attendance  (4.6  percent  nonresponse).  The 
highest  nonresponse  comes  with  56E  (extended  day  school)  with  39  percent 
illegitimate  blank  or  Don't  Know,  followed  by  Head  Start  (33.5  percent 
noniespt-iae)  and  nursery  school  or  pie  school  (16.6  percent  nonrecponse). 


Q56B  DID  R  GO  TO  DAY  CARE 


Value  Label 

Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

YES 

1 

399 

29.0 

33.0 

33  0 

NO 

2 

662 

48.1 

54.8 

87.8 

DK 

8 

148 

10.8 

12.2 

100.0 

MISSING 

9 

167 

12.2 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases       1209  Missing  Cases  167 
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DID  R  GO  TO  NURSERY  SCHOOL  OR  PRESCHOOL 


Value  Ubel 

YES 

HO 

DK 

HISSING 


Valid  C?s«ss  1258 
Q56D  DID  R  CO  10  HEAD  START 

Value  Label 


YES 

NO 

DK 

MISSING 


Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

1 

718 

52.2 

57.1 

57.1 

2 

429 

31.2 

34.1 

91.2 

8 

111 

8.1 

8.8 

100.0 

9 

118 

8.5 

MISSING 

TOTAL 

1376 

.100.0 

100.0 

Missing  Cases  118 


Valid 

Cum 

Value 

Prequency 

Percent 

Percent 

Percent 

1 

159 

11.6 

13.4 

13.4 

2 

/56 

54.9 

63.9 

77.3 

8 

268 

19.5 

22.7 

100.0 

9 

193 

14.0 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Valid  Cases 


1133 


Missing  Cases  193 


Q56E 


DID  R  GO  TO  EXTENDED  DAY  SCHOOL 


Value  Ubel 

YES 

NO 

DK 

MISSING 


Valid  Cases 


1170 


Valid 

Cum 

Value 

Frequency 

Percent 

Percent 

Percent 

1 

76 

5.5 

6.5 

6.5 

2 

764 

55.5 

65.3 

71.8 

8 

330 

24.0 

28.2 

100.0 

9 

206 

15.0 

MISSING 

TOTAL 

1376 

100.0 

100.0 

Missing  Cares  206 


Recommendations  for  these  items  will  be  made  in  the  course  of  the 
cross-validation  analysis  of  student  and  parent  reports  (3.2.7). 
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3.2.4     Inter-Item  Consistency 


Comparisons  among  a  respondent's  answers  to  related  questions 
(inter-item  consistency  checks)  provide  one  important  means  of 
assessing  the  accuracy  or  quality  of  data  for  a  given  item.      If  such  a 
comparison  reveals  a  high  degree  of  inconsistency,  then  both  items  must 
be  closely  scrutinized  to  see  which  is  more  conducive  to  accurate 
reporting— or  alternative  and  more  effective  ways  of  eliciting  the 
intended  information  must  be  sought. 


Because  of  the  need  to  minimize  respondent  burden  and  to  cover  as 
many  topics  as  possible  in  a  short  time,  there  are  few  instances  in  the 
field  test  student  questionnaire  of  items  that  are  close  enough  in 
their  focus  to  support  close  comparisons.    Never thelesss,  a  small 
amount  of  content  overlap  does,  by  design,  occur,  and  permits  testing 
of  alternative  questions  and  formats.    A  good  example  of  such  overlap 
is  found  in  two  pairs  of  questions  concerning  special  programs  and 
conditions—questions  48C  and  9B  on  services  for  orthopedic  impairment, 
and  questions  48D  and  9P  on  special  services  for  learning  problems. 
Neither  question  had  high  nonresponse. 

The  logical  structure  of  these  questions  is  not  one  of  strict 
identity,  but  of  a  broader  category  (embodied  in  question  9)  under 
which  the  narrower  category  (question  48)  can  be  subsumed.    Question  9 
asks    do  you  or  have  you  received  special  services  for"  either  of  the 
two  named  conditions.     Question  48  asks  whether  the  respondent  is 
currently  enrolled  in  the  services.    Anyone  who  answers  yes  to  question 
48  must,  on  pain  of  contradiction,  answer  yes  to  question  9.  However, 
one  could  consistently  answer  no  to  48  but  yes  to  9  and  one  could 
consistently  answer  no  to  both  48  and  9.    Contradiction  arises  when  one 
answers  yes  to  48  but  no  to  9,  as  illustrated  in  the  square  of 
relationship  below: 

* 

(time  reference): 
modality  relationship 
necessary  CONSISTENT 
posiible  CONSISTENT 
necessary  CONTRADICTORY 

A  further  twist  to  the  analysis  of  the  question  pairs  48C/9D  and 
48D/9P  is  that  parallel  questions  are  asked  of  an  additional  source, 
the  student's  parents.    Although  we  have  generally  made  parent-student 
data  comparisons  in  a  later  section,  it  seemed  appropriate  Lo  include  a 
discussion  of  the  parent  parallels  for  these  items  here.  The 
relationship  between  the  parent  and  student  questions  may  be  depicted 
as  follows  [where  arrows  denote  a  relationship  of  necessary  equivalence 
for  purposes  of  a  consistency  analysis—as  in  the  entailment  that 
everyone  who  answers  yes  to  48C  must,  on  pain  of  contradiction,  answer 
yes  to  9E;  and  the  relationship  between,  for  example,    9E  and  3-2E 
where  identical  questions  are  asked  about  the  student  and  only  the 
respondent  (eighth  grader  or  parent)  differs]: 


(now) 

(ever) 

q.48 

0^9 

YES 

YES 

NO 

YES  or  NO 

YES 

NO 
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STUDENT  PARENT 
ITEM  ITEM 


48C  <  >  3-12C 

I  I 

I  I 

V  V 
9E  <  >  3-2E 

Thus  four  possible  relationships  are  necessarily  inconsistent  if 
responses  to  both  terms  do  not  agree.    A  student  contradicts  himself  if 
he  amwers  yes  to  48C  but  not  to  9E?  a  parent  contradicts  himself  if  he 
answers  yes  to  3-22C  but  not  to  3-2E.    Students  and  parents  contradict 
each  other  when  they  respond  differently  to  48C  (student  question)  and 
3-12C  (parent  question)  or  to  9E  and  3-2E. 

3.2.4.1    Orthopedic  handicap;    9E  versus  48C  (Student  Self-Consistency) 

First  let  us  examine  the  inter-item  consistency  between  Quescion 
9E  and  Question  48C.    Question  9E  asks  "Do  you  or  have  you  received 
special  setvices  for  any  qr  all  of  the  following  conditions?.. .(e) 
Orthopedical  .y  impaired  (for  example,  club  foot,  absence  of  arm  or  leg, 
cerebral  palsy,  amputation,  polio)".    Question  48C  asks  "A#e  you 
enrolled  in  any  of  the  following... (c)  special  services  for  the 
orthopedically  handicapped."  Question  9E  also  appears  on  the  parent 
questionnaire  (Part  3,  2E)  as  does  48C  (Part  3,  12C)c  Please  refer  to 
Table  3-8  below  for  the  crosstabulat ion  of  9E  and  48C.    (This  table 
reflects  all  students  who  answered  both  questions.) 


TABLE  3-8 
CROSSTABULAT  ION  OF  Q.9E  AND  48C 

Q48C  YES  NO  TOTAL 
Q9E 

YES                     1  33  34 

NO                     30  1179  1209 

TOTAL                      31  1212  1243 


ERIC 


115 


154 


Some  1,1/9  respondents  answered  no  to  both  questions — they  were 
not  enrolled  in  programs  for  the  orthopedically  impaired  now,  nor  had 
they  ever  been  enrolled  in  these  types  of  programs.    One  respondent 
answered  yee  to  both  questions.    So  consistency  when  both  questions  are 
answered  oc cured  95  percent  of  che  time.    There  were  also  133 
observations  that  were  missing  (either  one  or  both  of  the  questions  had 
been  left  blank  so  no  comparison  could  be  made). 

While  the  overwhelmingly  negative  response  to  these  items 
underwrites  consistency  95  percent  of  the  time,  it  is  of  course  those 
who  answer  affirmatively—and  indicate  "hat  they  have  received  such 
services—who  are  of  special  policy  interest.    If  we  restrict  ourselves 
to  those  who  answered  yes  to  either  of  the  items,  of  64  students  who 
answered  yes  to  one  form  or  the  other  of  the  question,  only  one  student 
said  yas  both  times.    However,  owing  to  the  different  time  reference  in 
the  two  items,  only  thirty  of  these  cases  are  necessarily  inconsistent- 
-chose  who  who  said  "yes"  they  were  corrently  enrolled  in  a  program  for 
the^condition  of  being  orthopedically  impaired  (Q48)  but  who  answered 
no    when  asked  more  generally  in  Question  9— "have  you  ever  received 
special  services  for  thin  condition?".    Question  9B  has  the  advantage 
of  having  "orthopedically  impaired"  graphically  defined  by  listing 
examples  (club  foot,  absence  of  arm  or  leg,  cerebral  palsy,  amputation, 
polio).    Question  48  does  not  list  these  examples.  Since  question  9  is 
richer  in  exanples,  and  presumably  therefore  in  clarity,  one  would 
suppose  that  it  has  captured  the  more  accurate  reports.    This  surmise 
can  be  to  some  degree  confirmed  (or  disconf irmed)  by  reference  to  what 
the  students1  p  <-ents  reported  (they  answered  a  version  of  9E,  complete 
with  the  same  examples).    But  before  we  ask  whether  parent  reports  are 
in  closer  agreement  with  9E— or  with  48C~we  will  examine  the  question 
of  inter-item  consistency  on  the  :wo  versions  of  the  orthopedic 
question  in  the  parent  questionnaire.      Are  parent  reports  on  these 
items  more  consistent  than  those  of  students? 

3.2.4.2     Orthopedic  handicap:    3-2B  versus  3-12C  (Parent  Self 
Consistency) 

An  inter-item  consistency  check  was  performed  on  the  two  parent 
questions  (Q3-2E  and  3-12C).    Some  703  parents  (99  percent)  indicated 
their  child  was  not  enrolled  in  a  special  service  now  for  an  orthopedic 
problem  nor  had  they  ever  teen.    Eight  parents  answered  yes  to  the 
general  question  that  their  child  had  at  some  time  received  special 
services,  but  also  answered  that  the  child  was  not  enrolled  in  a 
service  now.  This  response  is  not  inconsistent,  and  the  inter-item 
consistency  check  thus  shows  the  parents  as  100  percent  consistent.  See 
Table  3-9  on  the  following  page. 
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T\BLE  3-9 

CONSISTENCY  CHECK  BETWEEN  Q1?C  AND  Q3.2E 


Q12C  YES  NO  TOTAL 
Q3.2E 

YES  0  8  8 

NO  0  703  703 

TOTAL  0  711  711 

3.2.4.3     Orthopedic  handicap:    3-2E  versus  9P;  3-12C  versus  48C 
(Parent-Student  Consistency) 

A  comparison  of  the  student's  answer  to  Question  9E  and  the 
parent's  answer  to  Question  3.2E  (Parent  Questionnaire)  could  be  made 
in  670  cases  where  both  student  and  parent  data  were  collected. 
Agreement  between  parents  and  students  occurred  96  percent  of  the  time. 
(Both  student  and  parent  answered  yes  or  both  pare  it  and  student 
answered  no).    However,  it  is  again  the  few  but  critical  yes  responses 
that  show  inconsistency— there  is  little  correspondence  in  student- 
parent  answers,  whichever  party  says  yes.  Eight  parents  said  that  their 
child  had  received  services  for  an  orthopedic  problem  but  only  two 
students  (25  percent)  admitted  receiving  these  services.    The  21 
students  who  affirmed  enrollment  were  contradicted  19  times  by  their 
parents.    Some  662  parents  answered  no  to  the  question  and  643  (97 
percent)  of  the  students  agreed  with  them.    Please  see  Table  3-10A. 

TAbLH  J-10A 

CONSISTENCY  CHFCK  BETWEEN  Q3.2E  AND  Q9E 

Q3.2E(Parents)  YES  NO  TOTAL 

Q9E( Students) 

YES  2  19  21 

NO  6  643  649 

TOTAL  8  662  670 
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A  comparison  of  the  studern's  answer  to  Q48C  and  the  parent's 
answer  to  Q12C  (Parent  0  -stir      \re)  could  be  made  in  663  cases  where 
both  student  and  parent  oata  were  collected.    Agreement  between  parents 
and  student  occurred  98  percent  of  the  time  ONLY  when  both  parent  and 
student  answered  no  to  these  questions.    When  the  student  answt.  ed  yes, 
they  were  enrolled  in  a  special  service  their  parents  disagreed  with 
them  100  percent  of  the  time.    (See  Table  3-10B  below.) 


TABLE  3-10B 
CONSISTENCY  CHECK  BETWEEN  Q12C  AND  Q48C 


Q12C(Parents)  YES  NO 

Q48C(Students) 


TOTAL 


YES  0  16  16 

W  0  647  647 


TOTAL 


663  663 


We  telephoned  a  subsample  of  ten  of  the  respondent  pairs  vhose 
answers  were  contradictory.    It  was  consistently  the  case  that  students 
and  parents  were  interpreting  the  questions  differently.    In  most 
cases,  the  affirmative  student  reply  on  9E  was  based  on  a  broken  Umb— 
a  condition  that  the  parent  was  equally  aware  of,  but  adjudged  not 
chronic,  and  to  be  outside  the  intentions  of  the  question.  Here  student 
error  was  abetted  by  the  examples  of  orthopedic  problems— club  foot, 
absence  of  limbs,  and  so  on— so  that  the  student  classed  fractured  or 
broken  limbs  as  orthopedic  impairments.  Another  area  of  ambiguity 
uncovered  was  as  to  whether  screening  procedures—or  only  treatment- 
should  be  considered  a  service  under  the  terms  of  the  question.  For 
question  48C,  however,  which  gave  no  examples,  students  often  seemed 
not  to  have  misunderstood  the  meaning  of  orthopedic— despite  having 
correctly  interpreted  it,  with  the  help  of  the  examples,  earlier  (9E). 
It  was  our  conclusion  that  while  both  sets  of  respondents  were 
attempting  to  give  honest  and  correct  answers,  parents  were  decidedly 
superior  interpreters  of  the  meaning  of  the  handicap  services 
questions. 

In  sum,  while  overall  inconsistency  on  the  orthopedic  services 
question,!  was  low,  when  analysis  is  limited  to  affirmative  responses, 
inconsistency  is  extremely  high.    Thirty  out  of  thirty-one  students  who 
answered  "yes"  to  48C  contradicted  themselves  on  9E.    However,  on  the 
same  items,  parents  vere  consistent  100  percent  of  the  time. 
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When  parent  reports  and  student  reports  on  the  same  item  are 
compared,  in  the  case  of  both  questions  parents  and  students  largely 
contradict  each  other.    When  parent  reports  on  3-2B  were  compared  to 
reports  on  the  parallel  student  item  (9B),  the  21  students  who  answered 
yes  to  the  question  were  contradicted  by  parents  90  percent  of  the 
time;  the  eight  parents  who  answered  yes  were  contradicted  by  their 
children  in  three  cases  out  of  every  four.    For  the  second  version  of 
the  orthopedic  question  (3-12C,  48C),  students  who  said  yes  were 
contradicted  by  their  parents  100  percent  of  the  time.    Again,  most 
parent  and  student  reports  of  orthopedic  services  are  negative, 
whichever  version  of  the  question  ia  asked— these  normally  agree.  But 
positive  reports,  compared  on  a  student-to-self  or  parent-to-student 
basis,  evidence  enormous  inconsistency,  regardless  of  which  version  of 
the  question  is  involved. 

3.2.4.4     Learning  Disability:    9F  versus  48D  (Student  Self- 
Consistency) 

Again,  though  otherwise  content  is  the  same,  question  9  has  broader 
temporal  reference  than  question  48.    Therefore  three  consistent 
combinations  are  licensed: 

48  9 

Yes  Yes 

No  Yes/No 

and  one  combination  is  contradictory  (one  cannot  answer  yes  to  48  and 
no  to  9).      Question  9F  reads  "Do  yoc  or  have  you  received  special 
services  for. ..(f)  Specific  learning  disability  (for  example,  imperfect 
aoility  to  liiten,  think,  speak,  read,  write,  spell,  or  do  mathematical 
calculations.)"    Question  48D  reads  "Are  you  enrolled  in  any  of  the 
following.... (c)  Special  Education  services  for  students  with  learning 
problems." 

Question  9F  also  appears  in  the  parent  questionnaire  (Part  3,  2F) 
in  form  identical  to  its  appearance  in  the  student.    Question  48D 
appears  in  the  parent  questionnaire  (Part  3,  12D)  wit''  a  slight 
variation  in^wording  "Special  education  services  for  slow  learners" 
instead  of  ("Special  Education  services  for  students  with  learning 
problems.") 

The  relationship  between  the  parent  and  student  question  responses 
may  be  depicted  as  follows,  where  arrows  denote  a  relationship  of 
necesF  iry  equivalence  for  purposes  of  a  consistency  analysis—as  in  the 
entailment  that  everyone  who  answers  yes  to  the  more  specific  48D  must, 
on  pain  of  contradiction,  answer  yes  to  the  more  general  9F;  and  the 
relationship  between,  for  example,  9F  and  3-2F  where  identical 
questions  are  asked  about  the  student  and  only  the  respondent  (eighth 
grader  or  parent)  differs.    (Note  that  since  question  wording  is  not 
identical  it  is  debatable  whether  48D  and  3-12D  are  identical— we 
provisionally  assume  their  equivalence  below.) 
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STUDENT  PARENT 
ITEM  ITEM 


48D  <  >3-12D 

I  I 

I  I 

V  V 
9P  <  >  Z  2P 

Pour  possible  relat  onships  are  necessarily  inconsistent  if 
esponses  to  both  terms  do  not  agree.    A  student  contradicts  herself  if 
she  answers  yes  to  48D  but  not  to  9P;  a  parent  contradicts  herself  if 
she  answers  yes  to  3-12D  but  not  to  3-2P.    Students  and  parents 
contradict  each  other  when  they  respond  differently  to  48D  (student 
question)  and  3-12D  (parent  question)  or  to  9P  and  3-2P. 

Please  refer  to  Table  3-11  below  for  the  analysis  of  Q9P  and  Q48D. 
Some  1128  students  answered  no  to  both  questions  and  18  answered  yes  to 
both  yielding  a  92  percent  consistency  in  inter-item  checks  (when  both 
questions  were  answered).    Some  130  respondents  left  one  or  both  of 
these  questions  blank. 

Some  54  respondents  indicated  that  they  w^re  not  enrolled  in 
special  education  services  for  students  with  learning  problems  now,  but 
they  answered  yes  to  Question  9P  when  asked,  "Do  you  or  have  you 

received  special  services  for  specific  learning  disability"?  This 

combination  of  answers  is  logically  possible.  However,  parent 
comparisons  suggest  the  degree  to  which  this  logical  possibility  may  or 
may  not  correspond  to  empirical  truth.      Parent  data  were  obtained  for 
27  of  these  students  and  16  (59  percent)  indicated  that  their  child  had 
never  received  special  services  for  specific  learning  problems  and  the 
remaining  11  (41  percent)  indicated  that  their  child  had  received 
special  services.    If  we  assume  that  the  parent  is  a  better  reporter  of 
this  information  (we  can  see,  at  least,  that  the  parent  is  a  more 
consistent  reporter  of  these  data)  this  comparison  implies  that  the 
level  of  inaccuracy  for  the  student  data  is  in  the  50  percent  range 
even  when  it  is  not  logically  inconsistent. 

Ocher  students  were  logically  inconsistent  in  their  responses. 
Some  46  students  were  inconsistent  with  their  answers  when  they 
indicated  they  were  now  enrolled  in  a  special  program  for  special 
education  services  for  students  with  learning  problems  (answered  yes  to 
Question  48D),  but  answered  no  to  the  broader  question  "have  you 
received  special  services  for  a  specific  learning  disability"  (answered 
no  to  Question  9P).    In  Question  9P  examples  of  a  learning  disability 
are  given,  while  in  Question  48D  the  question  refers  to  "services  for 
students  with  learning  problems".    Parent  data  were  available  for  14  of 
these  students  and  79  percent  of  the  parents  said  that  their  child  had 
not  received  these  special  services,  substantiating  the  inconsistency 
in  students  answers. 
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TABLE  3-11 


CONSISTENCY  CUECK  BETWEEN  Q48D  AND  Q9P 


Q48D 

YES 

NO 

TOTAL 

Q9P 

YES 

18 

54 

72 

NO 

46 

1128 

1174 

TOTAL 

64 

1182 

1246 

We  contacted  a  random  subsample  of  ten  of  the  pairs  of  disagreeing 
students  and  parents.    Where  parent  reports  diverged  from  student ,  we 
found  that  students  had  put  an  incorrect  interpretation  on  the 
question— that  they  meant  by  receipt  of  special  services  for  learning 
disability  that  they  had,  for  example,  been  screened  for  dyslexia,  or 
had  repeated  math,  or  had  taken  extra  coursework  in  summer  school.  As 
in  the  case  of  orthopedic  services,  parents  seemed  better  able  to 
correctly  interpret  the  question. 

3.2.4.5     Learning  Disability:    3-2F  versus  3-12D  (Parent  Consistency) 

An  inter-item  consistency  check  was  performed  on  the  two  parent 
questions  (Q3.2P  and  Q12D).    Some  647  parents  indicated  their  child  was 
not  enrolled  in  a  special  service  now  for  a  slow  learner  problem  nor 
had  they  ever  been.    Ten  parents  answered  yes  to  both  questions. 

Some  53  parents  indicated  that  their  child  was  not  enrolled  in  a 
service  now,  but  had  received  the  special  service  at  some  time.  The 
other  six  parents  were  inconsistent  in  answering  yes  to  the  specific 
question  of  their  child  being  enrolled  in  a  class  now,  but  no  to  the 
general  question.  Thus  inconsistency  occurred  in  6  out  of  716  cases 
(less  than  one  percent  of  the  time).    As  a  percentage  of  the 
affirmative  responses,  however,  inconsistency  occurred  37.5  percent 
(6/16)  of  the  time.    See  Table  3-12  below. 

TABLE  3-12 


CONSISTENCY  CHECK  BETWEEN  Q12D  AND  Q3.2F 


Q12D 

YES 

NO 

TCTAL 

Q3.2F 

YES 

10 

53 

63 

NO 

6 

647 

653 

TOTAL 

16 

700 

716 
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3.2.4.6     Learning  Disability:    3-2P  versus  9P;  3-12D  vet  jus  48D 
(Parent-Student  Consistency) 


A  comparison  of  the  student's  anSTter  to  Question  9P  and  the 
parent's  answer  to  Question  3.2P  (Parent  Questionnaire)  could  be  made 
in  678  cases  'here  both  student  and  parent  data  were  collected. 
Agreement  between  parents  and  students  occurred  90  percent  of  the  time. 
(Both  student  and  parent  answered  yes  or  both  parent  and  student 
answered  no).    Some  59  parents  said  that  their  child  had  received 
services  for  a  specific  learning  problem  but  only  15  students  (25 
percent)  admitted  receiving  these  services.    Some  617  par  nts  answered 
no  to  the  question  and  594  (96  percent)  of  the  students  agreed  with 
them.    Please  see  Table  3-13A. 


TABLE  3-13A 
CONSISTENCY  CHECK  BETWEEN  Q3.2P  AND  Q9P 

Q3  2 P( Parents)  YES  NO  TOTAL 
Q9P(Students) 

YES                                     15  23  38 

NO                                      44  594  638 

TOTAL                                   59  617  678 


A  comparison  of  the  student  answers  to  Q48D  and  parent  answers  to 
Q12D  could  be  made  in  667  cases  where  both  student  and  parent  data  were 
collected.    Agreement  between  student  and  parent  occurred  96  percent  of 
the  time  (both  studen    and  parent  answered  yea  or  both  student  and 
parent  answered  no).    Sixteen  parents  said  yes  their  child  was  enrolled 
in  a  special  service  for  slow  learning,  but  students  agreed  with  them 
only  50  percent  of  the  time.    Some  651  parents  said  that  their  child 
was  not  enrolled  in  this  special  service  and  their  children  agreed  with 
them  97  percent  of  the  time.    See  Table  3-13B. 
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TABLE  3-13B 


CONSISTENCY  CHECK  BETWEEN  Q12D  AND  Q48D 

Q12D(Parenti)                    YES                    NO  TOTAL 
Q48D( Students) 

YES                                      8                   20  28 

NO                                       8                  631  639 

TOTAL                                  16                  651  667 

In  sum,  on  the  special  education  services  for  students  with 
learning  problems  items,  findings  parallel  closely  those  for  the 
orthopedic  services  items.    Overall  inconsistency  was  low.  However, 
results  were  overwhelmingly  inconsistent  for  students  who  answered 
"yet"  at  least  oace — all  64  students  wto  answered  yes  to  430  should 
also  have  answered  yes  to  9P  but  only  18  did  so.    Seventy-two  percent 
(46)  of  them  contradicted  themselves  in  answering  9P. 

Parents  were  somewhat  more  consistent.    The  sixteen  who  answered 
yes  to  3-12D  should  also  have  answered  yes  to  3-2P— ten  did  so,  while 
six  (37.5  percent)  did  not,  thus  contradicting  themselves.  (However, 
the  variant  wording  for  3-12D  renders  this  contradiction  less  certain.) 
As  in  the  orthopedic  services  question,  parents  were  the  more 
consistent  .  ^porters. 

When  student  and  parent  reports  are  compared  (9P  with  3-2P,  48D 
with  3-120),  there  is  considerable  contradiction.    Of  38  students  who 
answered  yes  to  the  item,  parents  contradicted  them  in  23  cases  (60.5 
percent  of  the  time)  and  agreed  with  them  15  times  (39.5  percent  of  the 
time).    Of  59  parents  who  said  yes,  students  contradicted  them  44  times 
(74.5  percent  of  the  t  ime)  and  agreed  with  them  only  about  25  percent 
of  the  time.    Por  the  other  pair  of  special  education  services  for 
learning  problems  items  (12D/48D),  student-parent  reports  are  also 
contradictory.    Of  the  sixteen  parents  who  said  yes,  the  child  received 
such  services,  the  child  agreed  only  half  the  cases  (8).    Of  the  28 
students  who  reported  receiving  such  services,  parents  agreed  with  them 
8  times  (23.5  percent)  and  contradicted  them  20  times  (71.5  percent). 
Once  more,  overall  consistency  (based  on  the  predominantly  negative 
response)  was  high.    But  in  the  matter  of  affirmative  responses, 
students  were  extremely  inconsistent  and  parents  were  somewhat 
inconsistent.    For  both  items,  there  was  poor  agreement  between  student 
and  parent  responses. 

3.2.4.7      Inter-item  Consistency:    Conclusions  and  Recommendations 

It  seems  fair  to  conclude  from  the  analysis  of  the  special 
education  and  orthopedic  services  items  that  parent  response  is 
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generally  nor*  consistent  that  student  response,  and  that  student 
reports  appear  to  be  quite  unreliable.     In  terns  of  identifying  a 
bstter  respondent"  for  these  questions,  these  questions  night  better 
be  addressed  to  parents  than  to  eighth  graders.    Set  ool  records  night 
give  supplemental  accountings  of  program  participation,  although 
accuracy  and  accessibility  problems  linit  their  effective  use. 

In  addition,  it  would  seen  that  this  question  series  could  be  put 
with  greater  clarity.      For  example,  it  night  be  asked  whether  it  is 
desirable  to  collect  information  for  both  past  and  present  receipt  of 
these  services.      If  not,  then  reference  to  past  participation  should 
be  dropped.    If  so,  then  instead  of  the  present  item  9,  which  asks  "Do 
you  or  have  you  received  special  services  for  any  or  all  of  the 
following  conditions,"  past  and  present  should  be  split  into 
subquestions  to  be  answered  in  sepante  columns. 

Question  9  give    examples  of  orthopedic  inpairnents  and  learning 
disabilities.    Question  48  does  not.    The  crosstabulations  of  student 
and  parent  responses  show  that  both  forms  of  each  question  elicited  a 
similarly  high  proportion  of  inconsistencies.    Nevertheless,  common 
sense  and  accepted  instrument  development  practice  suggest  that  the 
question  with  the  examples  should  prove  clearer  and  more  effective.  It 
might  prove  clearer  still,  especially  to  students,  if  it  included  an 
example  of  what  not  to  include— namely,  temporary  inpairnents  such  as  a 
broken  leg  or  arm. 

3.2.5     Logical  Consistency  of  Responses  to  Filter  and  Dependent 
Questions 

A  major  empirical  question  of  the  field  test  was  whether  or  not 
eighth  grade  students  would  be  able  to  handle  skip  patterns  in  the 
survey  instruments  successfully.    A  skip  pattern  typically  is  conposed 
of  a  filter  question  with  routing  instructions  attached  to  answer 
categories,  a  dependent  question  or  set  of  dependent  questions  that 
immediately  follow  the  filter  question,  and  a  non-dependent  question 
after  the  dependent  questions.    The  routing  instructions  attached  to 
the  answer  categories  of  the  filter  question  tell  the  respondent 
whether  he  or  she  should  answer  the  dependent  questions )  or  skip  the 
dependent  question(s)  and  answer  the  first  non-depsndent  question. 

Skip  patterns  of  this  type  are  valuable  because  they  facilitate 
the  collection  of  data  from  targeted  sub-populations,  reducing 
respondent  burden  for  respondents  outside  the  targeted  sub-population 
and  increasing  the  quality  of  data  collected  by  screening  the 
respondents  to  particular  questions.    Both  researchers  and  respondents 
have  an  interest  in  the  successful  utilization  of  skip  patterns; 
researchers  obtain  data  of  higher  quality  while  respondents  are  spared 
the  frustration  of  having  to  answer  questions  irrelevant  to  their  own 
personal  circumstances. 
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But  skip  patterns  introduce  potential  difficulties  for  the 
respondent  in  saving  through  the  document.    Respondents  may  incorrectly 
follow  the  skip  pattern,  in  one  of  two  general  ways.    Residents  may 
•*ip  a  dependent  question  which  they  should  have  answered.  These 
errors  of  omission  have  serious  and  negative  effects  on  data  quality. 
Respondents  may  also  anrwer  a  dependent  question  that  they  should  have 
•kipped.    Though  the  effect  on  data  quality  is  less  pronounced  because 
a  decision  rule  may  be  developed  for  coding  the  data,  the  effect  on 
respondent  burden  is  high.    Moreover,  if  respondents  answer  dependent 
questions  thatthey  should  have  skipped,  the  chance  of  those 
respondents    completing  the  survey  instruments  in  the  time  allotted 
declines.    Thus,  the  potential  is  present  for  data  quality  of  -items  at 
the  end  of  the  questionnaire  to  be  adversely  affected. 

In  addition  to  these  difficulties,  skip  patterns  may  increase  the 
incidence  of  nonresponse  in  non-dependent  questions.    Respondents  may 
inadvertently  skip  the  first  one  or  two  non-dependent  questions  after 
the  dependent  questions,  thus  unnecessarily  lowering  the  response  rates 
for  those  items.    Respondents  may  also  develop  a  habit  of  skipping 
questions  because  of  the  inclusion  of  skip  patterns;  questions  which 
have  comparatively  long  context-establishing  introductions  may  be 
skipped  by  a  respondent  sensitized  to  the  legitimacy  of  skipping 
questions. 

Clearly,  the  potential  benefits  of  utilising  skip  patterns—the 
possibility  of  targeting  particular  questions,  the  opportunity  to  lower 
respondent  burden  —  must  be  balanced  by  an  assessment  of  the  risks 
involved.    Attempts  to  base  an  assessment  upon  the  experience  of  HS&B 
are  difficult.    The  HS&B  base  year  student  questionnaires  had  a  minimum 
of  skip  pattern  .    The  Sophomore  in« trument  did  not  have  any  skips,  and 
the  Senior  Questionnaire  had  only  two  simple  skips.    Still,  many  of  the 
issues  under  study  in  NELS:88  are  targeted  to  specific  populations  and 
under  these  conditions  efficiency  considerations  make  the  use  of  skip 
formats  highly  desirable.    The  field  test  provides  an  opportunity  to 
appraise  stud*      performance  on  the  skip  patterns,  and  to  assess  the 
impact  of  this  performance  on  data  quality  and  respondent  burden. 

There  were  sixteen  skips  within  the  student  survey  instruments. 
The  skip  patterns  may  be  divided  into  three  distinct  groups— first- 
order,  second-order,  and  third-order— based  on  the  visual  formatting  of 
the  skip  pattern  and  the  distance  between  the  filter  question  and  the 
first  non-dependent  question. 

Within  the  student  instruments  were  ten  first-order  skip  patterns. 
First-order  skips  involve  a  por  lible  skip  of  one  or  more  questions. 
Stude-  ts  are  instructed  to  skip  over  at  least  one  complete  question, 
depending  upon  the  student's  response  to  the  filter  question.  In 
addition,  there  were  four  second-order  skip  patterns.  Second-order 
skips  involve  a  multi-part  question  in  which  one  or  more  data  elements 
may  be  skipped.    Filter  questions  for  second-order  skip  patterns 
instructed  students  that  responded  in  a  particular  manner  to  skip  over 
the  remainder  of  the  question.    Lastly,  there  were  three  third-order 
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•kip  patterns.    Third-order  skip  patterns  technically  are  not  skips  at 
all,  because  they  do  not  have  a  filter  question  per  se.    Still,  they 
can  usefully  be  assimilated  to  this  model  because  they  may  help  to 
sensitise  the  respondent  to  the  presence  of  skip  instructions  in  the 
quest?  ^nnaire.    Third-order  f    ter  questions  provide  an  either/or 
option  for  students,  and  are  only  used  in  the  locator  items.  TLj 
typology  is  outlined  below,  in  Table  3-14: 

TABLE  3-14 

Skip  Pattern  Typology 


Def iuing 
Characteristics 

Potential  for 
Positi  se  and 
Negative  Effect 
on  Data  Quality 

Potential  for 
Positive  and 
Negative  Effect 
on  Burden 


First  Order 

Skip  at  least 
one  question 


Second  Order 

Skip  part  of 
one  question 


Third  Order 

Either/or 
option 


High 


Low 


Low 


High 


Medium 


Low 
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Incidence  of  Skips 

in  Locator  Booklet    Six  Three  Three 

Incidence  of  Skips 
in  Main 
Questionnaire 

Booklet  Pour  One  None 

Though  a  general  discussion  of  second-  and  third-order  skip 
patterns  is  provided,  most  attention  is  frcused  on  student  performance 
in  the  first  order  skip  patter;^.    First  order  skips  are  given  such 
attention  because  student  failure  to  properly  interpret  and  respond  to 
instructions  for  these  items  will  have  the  largest  potential  impact  on 
data  quality  and  impose  the  greatest  amount  of  unnecessary  respondent 
burden.    Moreover,  in  iterative  pre-t«sts  of  the  instruments  students 
experienced  the  most  difficulty  witn  first  order  skip  patterns.  Thus, 
each  of  the  f'rst  order  skip  patterns  will  be  discussed  below  in  some 
detail,  with  reference  to  the  first  dependent  question  after  the  filter 
question.    In  addition,  the  level  of  nonresponse  for  non-deoen lent 
questions  following  first  order  skips  is  also  examined  whe.  • 
appropriate,  to  fully  ajsess  the  impact  of  skip  formats  on  student 
questionnaire  performance.    Lastly,  it  was  also  \mp<       -it  to  obtain 
general  measures  of  student  performance  on  the  skip  posterns  in  order 
to  investigate  whether  many  students  were  making  at  most  one  skip 


pattern  error,  or,  rather,  that  nost  of  the  ski^>  pattern  errors  were 
committed  by  students  committing  more  than  one  errc-     This  approach 
facilitates  exploration  of  the  distribution  of  skip  pattern  error. 
These  general  mtasures  and  the  results  of  the  investigation  are  also 
discusseo. 

3.2.5.1  General  Discussion  of  Second-  and  Third-Order  Skip  Patterns 

In  general,  students  encountered  very  little  difficulty  in 
handling  second-  and  third-order  skip  patterns.    The  overwhelming 
majority  of  skip  pattern  failures  had  no  impact  on  data  quality.  For 
example,  in  Locator  Questions  3  and  5  several  students  placed  a 
checkmark  in  the  box  labeled  "Same  as  Mine",  therefore  indicating  that 
the  female  guardian  or  male  guardian  had  the  same  address  as  * 
student.    Some  of  the  students  who  checked  the  box  went  on  to  record 
the  address  again.    Thus,  their  failure  to  correctly  follow  the  skip 
instructions  increased  respondent  burden  for  those  particular  students, 
But  data  quality,  at  least  for  those  particular  questions,  was  not 
compromised. 

The  main  propose  of  th*  second-  and  third-order  skip  patterns  was 
tr   reduce  respoadent  burden.    In  some  of  the  first-order  skip  patterns 
response  inconsistencies  bvuween  the  filter  and  dependent  questions 
adversely  affects  data  quality.    But  with  the  second-  and  third-order 
skip  patterns  the  primary  goal  is  not  data  clarification;  v   tead,  the 
primary  goal  is  respondent  burden  reduction.    To  increase  tn* 
effectiveness  of  the  second-  and  third-order  skip  patterns  in  meeting 
this  goal,  the  use  of  routing  arrows  and  perhaps  shaded  text  areas  is 
suggested  for  the  base  year  version  of  the  questionnaire. 

3.2.5.2  First-Order  Skip  Patterns 

Below,  Table  3-15  lists  all  first  order  filler  questions,  the  two 
paths  available  to  students,  and  the  function  of  the  skip  pattern: 
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TABLE  3-15 


PJRST  ORDER  SKIP  PATTERNS 


NUMBER  FILTER  PATH  X 


Locator  Boo^le^ 
PATH  Y  USE  OF  SKIP  PATTERN 


Q2         Question  3/ 
Question  4 


Q4        Question  5/ 
Question  6 


Q14  Rest  of  Q14/ 
Queclion  15/ 
Question  16 


Q16  Question  17/ 
Question  18/ 
Question  19 


Q20       Question  21/ 

to  beginning  of 
Main  Quex 
Booklet 


Q28       Question  29 


Question  4 


Question  6 


Question  16 


Question  19 


Beginning  of 
Main  Quex 
Booklet 


Beginning  of 
Main  Quex 
Booklet 


To  allow  students  without  a 
living  female  guardian  to  skip 
out  of  question  3,  which  asks  for 
the  female  guardian's  address. 

To  allow  students  without  a 
living  male  guardian  to  skip  out 
of  question  5,  which  asks  for  the 
male  guardian's  addresa. 

To  allow  students  without  a 
second  possible  high  rchooi  to 
attend  to  skip  out  of  questions 
pertaining  to  a  second  possible 
high  school. 

To  allow  students  who  did  not 
speak  a  language  other  than 
English  prior  to  starting  school 
to  skip  out  of  questions 
pertaining  to  early  language 
acquisition* 

To  allow  students  who  do  not  have 
a  language  other  than  English 
spoken  in  their  home  to  skip  out 
of  Khe  minority  language 
supplement  items. 

To  allow  students  never  enrolled 
in  a  language  assistance  program 
to  skip  out  of  a  question 
cor^eming  when  they  were 
enrolled  in  such  a  program. 
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Main  Questionnaire  Booklet 


ORDER    FILTER  PATH  X  PATH  Y  USE  OF  SKIP  PATTERN 

7  Q4        Question  5/  Question  7  To  allow  students  born  in  the 

Question  6/  U.S.  (except  for  Puerto  Rico)  to 

Question  7  skip  over  questions  concerning 

the  arrival  and  early  school 
experience  of  immigrants  to  the 
U.S. 

8  Q7        Question  8/  Question  9  To  allow  students  who  have  n^t 

Question  9  completed  any  grades  in  schools 

outside  of  the  U.S.  to  skip  over 
questions  pertaining  to  grades 
completed  outside  of  the  U.S. 

9  Q31       Question  32/        Question  33  To  allow  students  who  have  not 

Question  33  received  information  concerning 

vocational  education  this  year  to 
skip  out  of  questions  pertaining 
to  the  source  of  the  information. 

1C        Q35       Question  36/        Question  38  To  allow  students  with  no  paid 

Question  37/  work  experience  to  skip  out  of 

Question  38  questions  pertaining  to  paid  work 

experience. 
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Ea-h  firbt  order  skip  pattern  is  discussed  in  turn.    For  each  situation,  -1 
indicates  missing  data,  unless  otherwise  specified. 

First  order  skip  pattern  number  1: 

Analysis 

.  This  skip  format  allowed  students  without  a  living  female  guardian  to  skip 
out  or  the  question  that  asks  for  the  address  of  the  femile  guardian.    Only  eight 
students  checked  the  box,  and  all  of  them  followed  the  routing  nstr«ctions 
appropriately.    Only  one  student  who  did  not  check  the  bor.  (and  did  noc      eck  the 
second-order  skip  pattern  "Same  as  Mine")  did  not  answer  the  dependent  question. 
Skip  pattern  error  is  0  percent.    Thus,  it  seems  that  this  skip  pattern  is 
working  well. 

Recommendation:  Retain  this  item  but  add  routing  arrows. 

First  order  skip  pattern  number  2: 

Analysis 

This  skip  pattern  allowed  students  without  a  living  male  guardian  to 
skip  out       the  question  that  asks  for  the  address  of  the  male  guardian. 
Eighty-four  students  checked  the  box;  of  these  eighty- four,  sever ty  followed 
the  routing  instructions  properly.    Fourteen  students  listed  an  address  in 
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the  dependent  question  for  a  male  guardian.    It  may  be  the  case  that  the 
father  of  these  students  has  died  and  the  mother  has  remarried;  thi  %  both 
responses  are  conceivably  appropriate  from  the  student1*  point  of  view. 
Again,  only   ne  student  who  did  not.  check  the  box  (and  did  not  check  the 
second-order  skip  pattern  'Same  as  Mine")  did  not  answer  the  dependent 
question* 

Though  it  is  possible  that  skip  pattern  error  is  as  high  as  17.5 
percent,  tue  possibility  that  students  whose  father  is  deceased  but  whose 
mother  has  remarried  would  respond  in  a  technically  incorrect  manner  to  the 
routing  instructions  is  sufficiently  high  as  to  make  ambiguous  any  judgments 
of  skip  pattern  performance  per  se  based  upon  this  example.    Given  that  data 
quality  is  not  compromised  nor  is  an  inordinately  high  respondent  burden 
imposed  for  students  responding  to  the  routing  instructions  in  a  technically 
incorrect  but  contextually  correct  manner,  it  seems  safe  to  conclude  that 
this  skip  patter-  is  working  well.    Indeed,  the  current  structure  of  the  skip 
pattern  may  cat: r  with  it  psychic  rewards  for  students  finding  themselves  in 
such  households,  for  "hey  are  able  to  acknowledge  the  deceased  father  and  the 
present  male  guardian  in  a  manner  that  does  not  impose  a  severe  and 
insensitive  rank,  order. 

Recommendation:  Retain  this  item  but  add  routing  arrows. 
First  order  skip  pattern  number  3: 

TABLE  3-16 

L0CAT5R  Q15:    OTHER  H.S.— PUBLIC/PRIVATR/NON-RELIGIOUS 
VS.  LOCATOR  Q14:     IS  THERE  AETHER  B.S.  R  MAY  ATTEND? 


Count 


Row 

Pet 

Locator  Q14 

Row 

Col 

Pet 

BLANK 

NO 

YES 

Total 

Locator  Q15 

BLANK 

-1 

35 

848 

5 

888 

,  3.9 

95.5 

.6 

64.5 

53.8 

96.3 

1.2 

PUBLIC 

1 

19 

14 

295 

328 

5.8 

4.3 

89.9 

23.8 

29.2 

1.6 

68.6 

RELIGIOUS 

2 

3 

6 

82 

91 

3.3 

6.6 

90.1 

6.6 

4.6 

.7 

19.1 

NON1ELIGIOUS 

3 

2 

4 

20 

7.7 

15.4 

76.9 

1.9 

3.1 

.5 

4./ 

DK 

8 

6 

9 

28 

43 

14.0 

20.9 

65.1 

3.1 

9.2 

1.0 

6.5 

Column 

65 

881 

430 

1376 

Total 

4.7 

64.0 

31.3 

100.0 

ERJ.C 


Analysis 


Students  answering  ftMOft  to  the  filter  question  were  instructed  to  skip 
Locator  Question  15.    There  were  881  "NO"  responses  to  the  filter  question, 
and  of  these,  96.3  percent  or  848  skipped  Locator  Question  15.     Of  the  430 
students  that  responded  affirmatively  to  the  filter  question,  only  1.2 
percent  incorrectly  skipped  the  dependent  question,    in  addition,  the  level 
of  nonresponse  for  the  first  non-dependent  question  after  the  skip  pattern 
was  well  below  th€  threshold  established  for  nonresponse.    Although  data  loi 
fron  this  skip  is  quit     ow  <<2  percent),  it  might  be  further  reduced  by 
im,,oved  formatting  and  use  of  routing  arrows. 

Recommendation:  Add  routing  arrows. 

Pirst  order  skip  pattern  number  A: 

TABLE  3-17 


CROS  STABULAT I  ON  OP  L17:    PIRST  LANGUAGE  SPOKEN  AS  A  CHILD 
VS.  L16:    BEFORE  SCH  DID  R  SPEAK  ANY  OTHER  LANGUAGE? 


Count . 


Ll6->     Row  Pet 

I  BLANK  ' 

1        Y  2S  | 

NO  | 

Row 

Col  Pet 

1  -1 

1           1  1 

2  1 

Total 

L17   

-+  

H  ►« 

 + 

-1 

1  33 

1       13  | 

780  | 

826 

I  4.0 

1      1.6  | 

54.4  | 

60.0 

1  76.7 

1      4.i  | 

76.8  | 

■■•  ►- 

1 

1  6 

1       51  i 

233  | 

290 

ENGLISH 

1  2.1 

1    17.6  | 

80.3  | 

21.1 

I  14.0 

1    16.1  | 

22.9  | 

.1  ~+- 

2 

I  1 

1      139  | 

140 

SPANISH 

1  .7 

1    99.3  | 

10.2 

1  2.3 

1    43.8  | 

ITALIAN  3 

I  1 

1       23  | 

1  | 

25 

FRENCH  & 

1  4.0 

1    92.0  | 

4.  )  1 

1.8 

GERMAN 

1  2.3 

1      7.3  | 

1  I 

CHINESE  &  4 

I  1 

1     •  44  | 

1  | 

46 

THE  4  APT 

1  2.2 

1    95.7  | 

2.2  | 

3.3 

LANGUAGES 

1  2.3 

1    13.9  | 

=  1  1 

9 

1         1  1 

1 

PORTUGUESE 

I  100.0  | 

.1 

1        .3  | 

11 

I  1 

1       46  | 

1  I 

48 

OTHER 

1  2.1 

1    95.8  | 

2.1  1 

3.5 

1  2.3 

1    1^.5  | 

•  1  1 

Column 

43 

317 

1016 

1376 

Total 

3.1 

23.0 

73.8 

100.0 

ERJ.C 
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Analysis 


This  is  the  first  of  the  skip  patterns  on  the  language  minority  items. 
This  filter  is  not  as  successful  in  all  regards  as  the  preceding  one.  Only 
76.8  percent  of  the  students  who,  because  of  their  negative  response  to  the 
filter  question  should  have  skipped  Locator  question  17,  actually  skipped 
LQ17.    Student  difficulty  with  this  item  is  probably  related  to  the  time 
I*"V"??,fd;  ,tudents  are  *«ked  whether  or  not  they  spoke  a  language  othe^ 
than  English  prior  to  entering  school.    Many  students  may  be  confused  by  the 
question.    The  major  impact  of  this  problem  is  on  respondent  burden. 

In  terms  of  data  quality  the  skip  *  it tern  performs  optimally.    Only  1.6 
percent  of  the  students  who  did  skip  should  not  have  done  so,  this 
translates  into  4.1  percent  of  the  studentu  who  should  have  answered  the 
dependent  question  owing  to  their  response  in  the  filter  question.  Thus, 
this  item  also  Is  performing  adequately. 

Recommendation:  Retain  this  skip  pattern,  but  format  with  a  routing  arrow. 
Pirst  order  skip  pattern  number  5i 


TABLE  3-18 


CROSSTABULATION  OP  L21:    »HAT  LANGUAGE  IS  SPOKEN  IN  YOUR  HOME? 
VS.  L20:    LANG  OTHER  THAN  ENGLISH  SPOKEN  IN  HOME 

Count  | 


L2o-> 

Row 

Pec 

1 

BLANK 

1        YES  | 

NO  | 

Row 

Col 

Pet 

i 

-1 

i      i  : 

2  1 

Total 

L21 

-1 

1 

5 

1        25  | 

758  | 

788 

1 

.6 

1      3.2  | 

96.2  | 

57.3 

1 

71.4 

1      5.8  | 

81.0  | 

1 

1 

1 

1      102  | 

176  ' 

279 

ENGLISH 

1 

.4 

1    36.6  | 

63.1  j 

20.3 

1 

14.3 

1    2j.6  | 

18.8  | 

2 

1 

'      168  | 

1  | 

169 

SPANISH 

1 

1    99.4  | 

.6  | 

12.3 

! 

1    38.8  | 

•i  ! 

ITALIAN, 

3 

1 

1       35  | 

35 

FRENCH  & 

1 

1  100.0  | 

2.5 

GERMAN 

1 

1      8.1  | 

+- 
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TABLE  3-18  (CON'T) 


CROSSTAB ULATION  OP  121:    WHAT  LANGUAGE  IS  SPOKEN  IN  YOUR  HOME? 
VS.  L20:    LANG  OTHER  THAN  ENGLISH  SPOKEN  IN  HOME 


Count 

| 

L20->  Row 

Pet 

1  BLANK 

1        YES  | 

NO 

| 

Row 

Col 

Pet 

1  -1 

1           1  1 

2 

j 

Total 

CHINESE  & 

4 

I  1 

1       54  | 

| 

55 

THE  4  API 

I  1.8 

I    98.2  | 

4.0 

LANGUAGES 

I  14.3 

1    12.5  | 

9 

1         1  1 

1 

PORTUGUESE 

I  100.0  | 

.1 

!       .2  1 

.4  + 

•+ 

11 

!       48  | 

1 

49 

OTF^R 

I    98.0  | 

2.0 

3.6 

I    11.1  1 

.1 

+  

H  ►■ 

■+ 

Column 

7 

433 

936 

1376 

Total 

.5 

31.5 

68.0 

100.0 

Analysis 

Student  responses  to  this  filter  question  determine  whether  or  not 
students  should  answer  the  language  minority  items.    Thus,  failure  to 
successfully  handle  this  skip  can  add  a  great  deal  of  time  to  th.it  necessary 
for  completion  of  the  survey  instruments,  not  to  mention  creating  frustration 
for  students  as  they  wrestle  with  questions  that  do  not  seem  to  pertain  to 
their  particular  circumstances. 

Given  the  importance  cf  this  filter  question,  it  is  distressing  to 
observe  that  only  81  percent  of  the  students  who  should  have  skipped  the 
first  minority  language  item  actually  did  so.    Eighteen  and  eight  tenths 
percent  of  the  students  who  should  have  skipped  Locator  Question  21  answered 

English"  to  Locator  Question  21,  the  first  dependent  question.    Responses  to 
Locator  Question  22  of  students  answering  "English"  to  Locator  Quest i'  i  ?1 
were  examined.    Locator  Question  22  asked  students  what  other  language  is 
spoken  in  their  home.    Ta*en  together,  these  first  two  dependent  questions 
provide  a  check  an  the  filter  item.    No  student  should  have  entered  the 
minority  lang  age  items  and  been  able  to  respond  "English"  to  the  first 
dependent  question   ;nd  "No  Other  Language"  to  the  second  dependent  question. 
This  response  pattern  is  indicative  of  a  routing  failure: 
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TABLE  3-19 


CROSSTABULATION  OP  L22:    WHAT  OTHER  LANG  SPOKEN  IN  YOUR  HOME? 
VS.  L20:    LANG  OTHER  THAN  ENGLISH  SPOKEN  IN  HOME 

(For  all  students  answering  "No"  to  Locator  Question  20  and  "English"  to 
Locator  Question  21,) 


L20-> 

L22 

Count 
Row  Pet 
Col  Pet 

-1 

|N0  | 

1           2  | 

1  55  | 
I  100.0  | 
1    31.3  | 

Row 
Total 

55 
31.3 

0 

NO  OTHER  LANGUAG 

1  101  | 
1  100.0  | 
1    57.4  | 

101 
57.4 

ENGLISH 

1 

1  17  1 
I  100.0  | 
1      9.7  | 

17 
9.7 

SPANISH 

2 

1  2  | 
1  100.0  | 

1    1.1  1 

2 

1.1 

ITALIAN, 
FRENCH  & 
GERMAN 

3 

1       1  1 

1  100.0  | 
1        .6  | 

1 
.6 

Column 
Total 

176 
100.0 

176 
100.0 

In  all,  of  the  176  students  answering  "English"  to  Locator  Question  21,  it 
seems  that  ) 18  students  answered  Locator  Question  22  in  a  manner  that  casts 
doubt  on  the  propriety  of  their  answering  nne  language  items,  while  another 
55  students  skipped  the  second  dependent  question.    The  value  of  the  "No 
Other  Language"  category  is  made  manifest  as  a  tool  for  clarifying  the  data 
after  skip  pattern  failures. 

Recommendation: 

Use  routing  arrows  to  further  clarify  the  skip  patterns,  use  different 
colored  pages  to  mark  the  language  items.    Consideration  also  might  be  gi^en 
to  separating  the  language  filter  and  dependent  questions  to  enable  survey 
personnel  to  designate  appropriate  respondents. 
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Pirat  order  skip  pattern  number  6: 


Analysis 

In  this  crosstabulation,  0.00  indicates  missing  for  the  dependent 
question,  Locator  Question  29.    Locator  Question  29  asks  for  the  grade  the 
•it£l£!5nt         "T011^  in  *  Unguag.  assistance  program.    If  a  student  answered 
TTES    to  the  filter  question,  "Were  you  evrr  enrolled  in  an  English 
language/language  assistance  program,  thac  is,  a  program  for  students  whose 
native  language  is  not  English?",  then  the  student  was  instructed  to  answer 
Locator  Question  29: 


TABLE  3-20 


CROSSTABULATION  OP  LOCATOR  QUESTION  29 
VS.  L28:    WAS  R  EVER  ENROLLED  IN  LANG  ASSISTANCE  PROGRAM? 


L28-> 
LQ  29 


Count 

IYES 

|NO  (MISSING 

\ 
1 

Row  Pet 

Row 

Col  Pet 

1  1 

1          2|  9 

1 

Total 

0.0 

1  4 

1      399    |  1 

1 

404 

1  1.0 

1    98.8    |  .2 

1 

81.0 

1  5.1 

1    95.2    |  100.0 

1 

1.00 

1  75 

1       20  | 

1 

95 

1  78.9 

1    21.1  | 

1 

19.0 

1  94.9 

1      4.8  | 

1 

♦ 

Column 

79 

419  1 

499 

Total 

15.8 

84.0  .2 

100.0 

Anal ysis 

A  tot*"  of  98.8  percent  of  those  that  responded  "NO"  to  Locator  Question 
28  skipped   ,ocator  Question  29  as  instructed,  and  only  1  percent  of  the 
students  that  should  have  answered  Locator  Question  29  illegitimately  skipped 
the  question.    The  positioning  of  this  filler  at  the  conclusion  of  the 
Locator  Booklet,  and  the  cl^ar  path  from  the  filter  to  the  dependent  question 
on  the  same  page  facilitated  student  attempts  to  fclow  the  skip  instruction. 

Recommenda t i  on : 

Retain  this  skip  pattern,  t  it  add  routing  arrows. 
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Pint  order  skip  pattern  number  7: 


Q4-> 


Q5 


TABLE  3-21 

CROSSTABULATI OW  OP  Q5:    AGE  PIRST  ARRIVED  IN  U.S./D.C. 
VS.  Q4:    HERE  YOU  BORN  U.S. /PUERTO  RICO/ ANOTHER  COUNTRY? 

Count 
Row  Pet 

Col  Pet 


-1 


1  YEAR  OLD  OR 
LESS 


OLDER  THAN  1  YR 
YOUNGER  THAN  5  . 

OLDER  THAN  5 
YOUNGER  THAN  10 


OLDER  THAN  10 
YOUNGER  THAN  16 


Column 
Total 


BLANK 

I  USA  | 

ABROAD  | 

Row 

-1 

1           1  1 

2  1 

Total 

28 

1     1126  | 

6  1 

1160 

2.4 

1    97.1  | 

•5  | 

84.3 

77.8 

1    95.9  | 

3.6  | 

— — — — — — 

•♦  ♦ 

 + 

1 

1       42  | 

24  | 

67 

1.5 

I    62.7  | 

35.8  | 

4.9 

2.8 

1      3.6  | 

14.5  | 

H  -+• 

5 

1              1  1 

59  | 

65 

7.7 

1      1.5  | 

90.8  | 

4.7 

13.9 

1       .1  1 

35.5  | 

2 

1        4  | 

53  | 

59 

3.4 

1      *.8  | 

89.8  | 

4.3 

5.6 

1         3  | 

31.9  | 

1         1  1 

24  | 

25 

1      4.0  | 

96.0  1 

1.8 

1       .1  1 

14.5  | 

36 

1174 

166 

1376 

2.6 

85.3 

12.1 

100.0 

Analysis 

This  is  the  first  of  the  skip  patterns  in  the  Main  Questionnaire 
Booklet.    Students  born  in  the  United  States  (not  including  Puerto  Rico)  were 
instructed  to  skip  Question  5.    A  total  of  95.9  percent  of  them  did  so. 
A)  ao,  less  than  1  percent  of  the  students  who  should  not  have  skipped 
t    ually  incorrectly  skipped  Question  5.    In  addition,  the  nonresponse  rate 
for  the  first  nondependent  question  after  this  skip  pattern— the  nonresponse 
rate  for  question  7— is  2.7  percent  below  the  eight  percent  margin 
established  for  noncritical  items.    Thus,  all  indicators  poi:.c  to  a  positive 
interpretation  of  student  performance  on  this  skip  pattern. 

Recommendation: 


Retain  this  skip  pattern,  but  add  routing  arrows. 
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Pint  order  ultip  pattern  number  8: 
Anal yg is 

Question  7  is  a  filter  question,  with  instructions  for  students 
responding  affirmatively  to  continue  on  to  Question  8.    For  Question  8. 
indicates  that  the  student  skipped  the  question: 


T/3LE  3-22 


CROSSTABULATION  OP  Q8 
VS.  Q7:    COMPLETED  ANY  GRADES  OUTSIDE  U.S./D.C. 


Count     | YES         |N0  | 
07->     Row  pct  |  |  |  Row 

Col  Pct  |  1  |  2|  Total 


Q8 


-+  

0.0 

1        13  | 

1188  | 

1201 

1.     1.1  | 

98.9  | 

92.1 

1     12.1  | 

99.2  | 

1.00 

;       94  | 

9  1 

103 

1    91.3  | 

8.7  | 

7.9 

1    87.9  | 

.5  1 

Column 

107 

1197 

1304 

Total 

8.2 

91.8 

100.0 

Analysis 

Over  99  percent  of  the  students  who  should  have  skipped  Question  8  did 
so;  j.i  terms  of  respondent  burden  this  question  is  performing  at  the  highest 
level.    But  12.1  percent  of  the  students  who  answered  "YES"  to  Question  7 
failed  to  respond  to  Question  8,  and  this  is  an  unacceptable  level  of  data 
less.    One  reason  for  the  poor  performance  of  students  in  moving  from  the 
filter  to  the  dependent  question  in  this  skip  pattern  is  that  the  two  items 
do  not  fall  on  the  same  r»ge.    Though  they  are  located  on  facing  pages,  it 
seems  that  this  separation  is  sufficient  to  create  a  large  and  unacceptable 
loss  of  data. 

Recommendation: 

Place  the  filter  and  dependent  questions  on  the  same  page  and  use  arrows 
to  facilitate  proper  routing  of  the  respondent. 
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Pint  order  skip  pattern  number  9: 


TABLE  3-23 


CROSSTABULATION  OP  Q32 
VS.  Q3i:    HAS  R  RECEIVED  INFO  ON  VOCATIONAL  ED? 


Q31-> 


Q32 


Count 

lYES 

|NO  | 

Row  Pet 

i 

low 

Col  Pet 

1  1 

1          2  | 

Total 

+-  * 

0.0 

1  14 

1     982  | 

996 

1  1.4 

1    98.6  | 

74.7 

1  4.2 

1    98.3  | 

1.00 

1  320 

1       17  | 

337 

1  95.0 

1      5.0  | 

25.3 

1  95.8 

1      1.7  | 

Column 

334 

999 

1333 

Total 

25.1 

74.9 

100.0 

Analysis 

Por  Question  32,  zero  indicates  that  the  student  skipped  the  question. 
Ninety-eight  and  three  tenths  percent  of  the  students  instructed  to  skip 
Question  32  did  so,  while  only  4.2  percent  of  the  students  who  should  not 
have  skipped  did  so.    The  level  of  missing  data  for  the  first  non-dependent 
question  after  the  skip  pattern  is  low,  only  3.6  percent,  indicating  that  the 
skip  pattern  did  not  appreciably  effect  the  movement  of  students  through  this 
juncture  of  the  document. 

Recommendation: 

Retain  this  item  but  add  routing  arrows. 

Pirst  order  skip  pattern  number  10: 

TABLE  3-24 

CROSSTABULATION  OP  Q36:    WHAT  KIND  OP  WORK  R  DID  ON  RECENT  JOB 
VS.  Q35:    HOW  MANY  HOURS  DO  YOU  WORK  ON  YOUR  JOB? 


Count 

Q35-> 

Row  Pet 

I  BLANK  j 

NVR  WRK 

WORKED  | 

Row 

Col  Pet 

1         -1  1 

0 

1  | 

Total 

Q36 

-1 

1       49  | 

498 

71  I 

618 

1      7.9  | 

80.6  | 

11.5  | 

44.9 

1     26. 0  | 

86.3  | 

9.6  | 

0 

1         5  | 

45  | 

19  | 

69 

DID  NOT 

WORK 

1      7.2  | 

65.2  | 

27.5  | 

5.0 

FOR  PAY 

1      8.8  | 

7.8  | 

2.6  | 

ERIC 
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TABLE  3-24  (COM'T) 


CROSSTABULATIOM  OP  Q36:    WHAT  KIND  )P  WORK  R  DID  ON  RECENT  JOB 
V3.  Q35:    HOW  MANY  HOURS  DO  YOU  WORK  ON  YOUR  JOB? 

Count  | 


>->     Row  Pet 

1  BLANK 

I  NVR  WRK| 

WORKED  | 

Row 

Col  Pet 

1  -1 

1        o  1 

1  1 

Total 

1 

1  3 

1       34  | 

652  | 

689 

WORKED 

1  .4 

1      4.9  | 

94.6  | 

50.1 

PAY 

1  5.3 

1      5.9  | 

87.9  | 

<  -♦■ 

Column 

57 

577 

742 

1376 

Total 

4.1 

41.9 

53.9 

100.0 

Analysis 

Students  did  not  handle  this  skip  pattern  with  the  facility 
exhibited  on  other  skip  patterns.    Eighty-six  and  three  tenths  percent 
of  the  students  instructed  to  skip  Question  36  did  so;  9.6  percent  of 
the  students  instructed  to  answer  Question  36  did  not.    This  level  of 
data  impurity  is  not  acceptable.    The  high  level  of  student  difficulty 
can  be  traced  to  the  inclusion  in  the  first  dependent  question  of  a 
category  to  accomodate  students  who  failed  to  successfully  handle  the 
skip  pattern.    The  inclusion  of  this  option  may  have  confused  students. 

Recomnenda  t  i  on : 

Either  remove  the  skip  instructions,  or  remove  the  category  for 
students  that  'til  the  skip  instruction. 

3.2. 5. 3     Analysis  of  Skip  Pattern  Indices 

In  order  to  further  investigate  student  performance  on  all  the 
major  first  order  skip  patterns,  two  scales  were  developed.    One  scale, 
FOSSGAL1,  measures  student  performance  on  the  skips  with  no  regard  for 
the  fffect  of  that  performance  on  data  quality.    This  is  the  more 
sensitive  of  the  indices,  and  reflects  the  important  consideration  of 
respondent  burden.    The  second  scale,  FOSSCAL2,  measures  skip  pattern 
errors  that  adversely  affect  data  quality.    Each  scale  varies  between 
zero  and  one,  with  zero  indicating  optimal  skip  pattern  performance, 
and  one  indicative  of  a  student  that  missed  every  first  order  skip 
•pattern  to  which  he  or  she  was  exposed.    Each  scale  is  based  on  student 
performance  in  eight  of  the  ten  skip  patterns.    The  first  and  second 
skips  were  not  included  in  th    scale  because  of  the  ambiguity 
surrounding  possible  student  skip  pattern  errors,  discussed  above  in 
the  treatment  of  skip  pattern  two.    The  frequenciss  of  the  two  scales 
are  provided  below,  in  Table  3-25: 
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TABLE  3-25 


P0SSCAL1 


f  aim 

Cum 

Value 

Preauencv 
883 

rci  wciib 

r ere en i 

0.00 

64  2 

7 

AA  7 

.13 

93 

6.8 

&  ft 

71 

/I  •  D 

.14 

177 

12  9 

.17 

38 

2  8 

9  ft 

ft7  1 

.20 

6 

A 
.  H 

ft7  7 

.25 

47 

3.4 

J « 

01  1 
7l  •  1 

.29 

61 

4  4 

73  .0 

.33 

9 

7 
.  # 

7 

.38 

16 

j  ,2 

07  A 

.40 

5 

.4 

A 

Q7  ft 

7/  •  O 

.43 

13 

.9 

1.0 

98.8 

.50 

*. 

.3 

.3 

99.0 

.57 

3 

2 

o 
.  & 

00  1 

77  *<J 

.60 

1 

.i 

.1 

99.3 

,63 

1 

•  j 

.1 

99.4 

.67 

1 

,1 

.1 

99.5' 

.71 

1 

A 

.1 

99.6 

.75 

2 

ml 

.1 

9.7 

.80 

1 

.1 

.1 

99.8 

.86 

1 

.1 

.1 

99.9 

1.00 

2 

.1 

.1 

ICj.O 

• 

11 

.8 

MISSING 

TOTAL 

1376 

100. 0 

100.0 

V»lid  Cases       1365  Missing  Cases       11  Mean  .08 

P0SSCAL2 


Valid 

Cum 

Value 

Prequency 

Percent 

Percent- 

Percent 

0.00 

1224 

89.0 

89.. 

89.7 

.13 

48 

3.5 

3.5 

93.2 

.14 

65 

4.7 

4.8 

97.9 

.17 

12 

.9 

.9 

98.8 

.20 

3 

.2 

.2 

99.0 

.25 

6 

.4 

.4 

99.5 

.29 

4 

.3 

.3 

9!). 8 

.33 

1 

.1 

.1 

9«>.9 

.40 

1 

.1 

.1 

9S.9 

.50 

1 

.1 

.1 

100.0 

. 

11 

.8 

MlaSING 

TOTAL 

137u 

100.0 

100.0 

Valid  Caces       1365  Miss'ng  Cases       11        Mean  .02 
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Perusal  of  the  frequency  distribution  of  P0SSCAL2  reveals  that 
89.7  percent  of  the  students  made  no  errors  resulting  in  a  reduction  of 
data  quality  witii  any  of  the  first  order  skip  patterns.    The  first, 
■ore  sensitive  scale,  indicates  that  64.7  percent  of  the  students  had 
no  problem  with  any  of  the  skip  patterns. 

Scores  for  both  frequency  distributions  are  concentrated  in  the 
lower  reaches  of  the  scale,  suggesting  that  most  individual  students 
did  not  make  very  many  skip  pattern  errors.    Instead,  many  students 
made  one  or  two  errors.    Thus,  the  individual  skips  themselves  can  be 
altered  to  enhance  student  performance;  the  concept  of  skipping 
questions  as  instructed  is  not  so  unfamiliar  to  students  that  they 
cannot  follow  these  instruction*. 

To  investigate  the  skip  pattern  performance  of  different  types  of 
students,  sec  is  on  each  of  the  skip  pattern  scales  were  recoiled  into 
two  groups,  scores  indicative  of  no  errors  for  a  particular  student 
(0),  and  scores  indicative  of  one  or  more  skip  pattern  errors  by  the 
student  (>0).    The  recoded  skip  pattern  scales  were  cross tabulated  with 
an  SES  scale  and  grades  b>  self-report.    The  SES  scale— a  composite 
variable  based  on. student  report  of  parental  occupation  aad  education- 
has  been  recoded  to  take  on  the  values  one,  for  low  SES,  two,  for 
middle  SES,  and  three,  for  high  SES.    Results  of  the  SES 
crosstabulatlon,  immediately  below,  strongly  suggest  that  skip  pattern 
error  occurs  in  each  of  the  three  socioeconomic  classes  to  roughly  the 
same  degree.    Thus,  it  seems  tto*r  the  skip  patterns  do  not  present  a 
greater  problem  for  low-,  middle-,  or  high-socioecouxnic  status  groups. 


TABLE  3-26 
CROSSTABULATIGiJ  OP  P0SSCAL1  VS,  SES1 


SESl-> 
P0SSCAL1 


Count  | 


Row  Pet 
Col  Pet 

1 

I        1.00 | 

2.001 

1 

3.00| 

Row 

Total 

0.0 

1      347  | 
!    41.4  | 
1    63.4  | 

360  | 
42.9  | 
66.9  | 

132  | 
15.7  | 
68.0  | 

839 
65.6 

1.00 

I      200  | 
1    45.5  | 
1    36.6  1 

178  | 
40.5  | 
33.1  | 

62  | 
14.1  | 
32.0  j 

440 
34.4 

Column 
Tctel 

547 
42.8 

538 
42.1 

194 
15.2 

1279 
100.0 
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CROSSTABULATTON  OP  POSSCAL2  VS.  SES1 


SESl-> 
POSSCAL2 


Count 
Row  Pet 

Col  Pet 

0.0 


1.00 


i.ooi  :  ooi 

 4  

491    |  492  | 

42.7  |  42.7  | 

89.8  |  91.4  | 

56    I  *6  | 

43.8    I  35.9  | 

10.2    |  8.6  | 

Column        547  538 

Total       42.8  42.: 


3.001 


168 
14.6 
86.6 

26 
20.3 
13.4 

194 
15.2 


Bow 
Tocal 

1151 
90.0 


128 
10.0 


1279 
100.0 


Students  with  nigh  and  low  grades  were  compared.    The  results  of 
this  crosstabulation  for  each  of  the  scales  is  immediately  belcw,  and 
suggests  that  •  tudents  whose  self-reported  grades  are  low  make  more 
•kip  pattern  errors  in  general,  but  do  not  make  appreciably  more  errors 
with  negative  effects  on  data  qual:*-y. 


TABLE  3-27 


CROSSTABULATION  OP  PCSSCAL1 
VS.  Q63:    WHAT  BEST  DESCRIBES  R  GP*DES  IN  SCHOOL? 


Q63-> 
POSSCAL1 


Count  | 


Row  Pet 

i 

LOW 

1    HIGH  | 

Row 

Col  Pet 

i 

0 

1          1  1 

Total 

0.0 

i 

92 

1      202  | 

294 

i 

31.3 

I    68.7  | 

70.2 

i 

56.8 

1    78.6  | 

1.00 

i 
i 

70 

h  ► 

1       55  | 

125 

i 

56.0 

1    44.0  | 

29.8 

i 

+— 

43.2 

I    21.4  1 

Column 

162 

257 

419 

Total 

38.7 

61.3 

100.0 
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CROS ST ABULAT ION  OP  FOSSCAL2 
VS.  Q63t    WHAT  BEST  DESCRIBES  R  GRADES  IN  SCHOOL? 


Count  | 

Row  Pet  |      LOU    |    HIGH    |  Row 
Col  ?ct  |          0|          1  |  Total 
 ►  + 

0.0  |  144  |  237  |  381 
I  37.8  |  62.2  |  90.9 
I    88.9    |    92.2  | 

♦  +-  ► 

1.00    |       18    |       20    |  38 
I    47*4    |    52.6    |  9.1 
I    U.l    I      7.8  | 
♦  ♦  + 

Column        162  257  419 

Total       38.7        61.3  100.0 

In  addition,  a  check  of  completion  of  the  latter  questionnaire 
items  by  performance  on  FOSSCAL1  revealed  that  only  one  student  did  nrt 
complete  the  latter  questions.    This  student  iid  not  make  any  skip 
errors.    Therefore,  it  seems  that  routing  errors  did  not  increase 
respondent  burden  so  much  that  completion  of  the  student  instruments 
became  problematic,  thus  negatively  affecting  data  quality  for  the 
concluding  questions. 

3.2.5.4     General  Conclusions 

The  experience  of  the  field  test  seems  to  suggest  that  eigbth 
grade  students  are  able  to  successfully  handle  skip  patterns.  Over 
sixty-four  percent  of  the  students  were  able  to  complete  the  survey 
instruments  without  making  a  single  skip  pattern  ^rror,  and  89.7 
percent  were  able  to  complete  the  survey  instruments  without  making 
errors  that  negatively  affecced  data  quality.    The  rate  of  success  in 
handling  the  skip  patterns  did  not  correlate  with  differences  in 
socioeconomic  status,  nor  was  there  a  manifest  bias  against  students 
with  lev  self-reported  grades.    There  was  no  correlation  between  skip 
pattern  error  and  failure  to  complete  the  survey  instruments;  data 
quality  on  the  last  items  in  the  questionnaire  does  not  suffer  because 
of  the  incidence  of  skip  pattern  srror.    Similarly,  non-dependent 
questions  following  dependent  questions  did  not  register  inordinately 
high  levels  of  non response. 

Still,  the  lessons  of  the  fieid  test  may  be  employed  to  improve 
student  performance.    The  base  year  questionnaire  should  retain  ckip 
formats  where  they  contribute  to  the  logic  and  efficiency  of  the 
questionnaire  and  to  the  goal  of  minimizing  respondent  burden.  The 
inclusion  of  the  proofed  item  and  format  modification-  in  the  base 
year  instrument  will  ircilitate  student  adherence  to  routing 
instructions.  Mo*t  skip  errors  led  students  into  a  question  series  they 
did  nor  need  to  answer.  For  this  reason  the  question(s)  following  a 
filter  question  should  always  contain  a  "redundant"  response 
appropriate  for  those  respondents  who  should  have  been  screened  out. 
Also,  consideration  should  lr  given  to  adding  an  illustration  of  a  skip 
instruction  into  the  preliminary  examples.    Inclusion  of  an  example 
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questions  renders  an  analysis  of  -response  variation  based  upon  the 
presence  of  an  answer  for  these  questions  ambiguous  at  best,  the  final 
two  questions  fro*  the  Main  Questionnaire  booklet  were  not  used  in  the 
comparison  of  nonrespotse  rates.  (However,  we  did  check  the  last  item 
in  the  questionnaire— 66— to  see  how  many  students  had  answered  it  at 
least  once.    All  1375  respondents  h^d  at  least  one  response  to  the 
multi-element  final  question.)  One  caveat  that  should  be  entered  here 
is  that  such  a  comparison  is  in  one  sense  unfair— there  were  no 
critical  items  in  the  lattt.*  part  of  the  questionnaire,  so  that  a 
nuaber  of  early  questions  had  the  benefit  of  retrieval— a  procedure 
that  boosts  the  response  rate—  while  the  latter  items  did  not. 

In  addition  to  comparing  items  in  different  sections  of  the  survey 
instruments,  the  concluding  items  are  compared  with  one  another  in  an 
effort  to  discover  the  point  in  the  questionnaire  at  which  response 
rates  begin  to  decrease  significantly. 

Columns  1  and  3  in  Table  3-28  below  list  the  percentage  of  blanks 
for  the  first  fifteen  closed-ended  nondependent  items  in  the  survey 
instruments  and  fifteen  of  the  last  seventeen  items  in  the  survey 
instruments.    Column  2  and  Column  4  in  Table  3-28  list  the  nonresponse 
rates  for  the  two  sets  of  questions. 
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TABLE  3-28 


Initial  Items 


1 

2 

Pet 

Non 

Question 

Blank 

Response 

LQ8 

1.4 

1.5 

LQ10 

.2 

.3 

LQ12 

1.2 

5.4 

LQ13 

.5 

32.4 

Till  A 

A  7 

4. 7 

LQ16 

3.1 

3.1 

LQ20 

.2 

.5 

MQ1 

2.5 

9.1 

MQ2 

.1 

1.0 

MQ3A 

3.2 

3.3 

MQ3B 

6.7 

6.9 

MQ3C 

9.5 

9.7 

MQ4 

.3 

2.6  . 

MQ7 

5.2 

5.2 

MQ9A 

3.6 

3.8 

He  an 

2.83 

5.97 

Median 

2.5 

3.8 

Concluding  Items 


3 

4 

Pet 

Non 

Question 

Blpnk 

MQ59 

2.4 

2.4 

MQ60A 

3.6 

3.7 

MQ60B 

4.3 

4.4 

MQ60C 

4.0 

4.2 

MQ60D 

3.9 

3.9 

MQ61B 

4.1 

4.2 

MQ61C 

J. 8 

3.9 

MQ61D 

4.5 

4.6 

MQ61E 

6.0 

6.2 

HQ62 

3.1 

3.4 

MQ63 

3.6 

6.2 

HQ64A 

3.5 

4.5 

MQ64B 

3.4 

4.9 

MQ64: 

3.4 

4.6 

MQ64D 

3.6 

5%.0 

Mean 

3.81 

4.41 

Median 

3.6 

4.4 

The  mean  percent  blank  for  the  initial  items  is  2.83  percent;  for 
the  concluding  items  it  is  3.81  percent.    Approximately  a  one  percent 
difference  is  observed  between  the  two  groups.    A  slightly  higher 
difference  is  observed  between  the  mesn  nonresponse  rates  for  the  t *o 
sets  of  items,  and  the  direction  of  the  difference  seems  to  cast  doubt 
upon  the  efficacy  of  an  analysis  of  response  variation  by  position  of 
the  item  in  the  questionnaire.    The  mean  nonresponse  rate  for  items  at 
the  beginning  of  the  questionnaire  is  higher  than  that  for  items  at  the 
end  of  the  questionnaire.    The  direction  of  the  difference  of  the  mean 
nonresponse  rates,  however,  is  related  to  the  extremely  high 
nonresponse  rate  of  32.4  percent  recorded  for  Locator  Question  13. 

A  check  of  the  median  for  each  of  the  two  groups  will  assist  in 
sorting  out  what  seems  to  be  conflicting  evidence.    Though  the  means 
are  of  assistance  in  comparing  the  two  groups,  the  median  is  of  more 
value  in  both  comparing  the  two  groups  and  describing  the  groups  in 
terms  of  overall  performance  relative  to  an  absolute  standard.  The 
mean  is  of  less  value  in  this  situation  because  it  is  sensitive  to 
relatively  minor  variations  in  the  values  at  both  the  high  and  low 
extremes.    The  extreme  values  observed  in  the  table  are  more  indicative 
of  characteristics  of  the  particular  questions  involved;  the  relevance 
,    .   of  the  extreme  values  to  an  analysis  of  response  variation  by  item 
position  in  the  documer  ts  is  overstated  by  "he  use  of  the  mean. 

The  median  percentage  blank  for  the  ini:ial  items  is  2.T>  percent; 
the  median  for  the  concluding  items  is  3.6  percent.    The  difference 
between  the  two  groups  holds  at  approximately  one  percent.  The 
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difference  in  Che  median  nonresponse  rates  is  approximately  .6  percent, 
and  the  lower  median  is  observed  for  the  initial  items. 
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The  differences  in  the  mean  and  median  percentage  of  blanks  and 
the  radian  nonresponse  rates  for  the  two  groups  is  small  enough  to 
conclude  that  relative  to  the  initial  items  in  the  survey  instruments, 
data  quality  for  the  latter  items  is  no*-  appreciably  affected  by  their 
placeaenc  at  the  conclusion  of  the  survey  instruments.    It  is  worth 
noting  that  the  overall  performance  of  the  two  groups  or  questions 
appears  to  be  slightly  better  when  the  median  is  used  than  when  the 
mew  is  used,  an  indication  that,  with  the  exceptior  of  a  few  questions 
•"'  at  score  on  the  extreme  high-end  of  the  nonresponse  scale,  students 
are  able  to  provide  resj.   tses  to  the  questions. 

Apart  from  comparisons  with  the  initial  items  of  the  survey 
documents,  the  concluding  questions  do  not  seem  to  register  increasing 
rates  of  blanks,  and  the  ratb  of  nonresponse  increases  only  marginally . 
Variance  is  mure  related  to  the  content  of  particular  items  than  to  tM 
placement  of  the  item  close  to  thr  conclusion  of  t**i  questionnaire. 
Por  example,  the  comparative^  high  rate  of  blanks  for  Main 
Questionnaire  Question  61P  appears  to  be  primarily  related  to  the 
content  of  the  question.    Main  Questionnaire  Questions  61A  through  61D 
ask  students  how  much  time  they  spend  on  homework  for  Mathematics, 
Science,  English,  and  Social  Studies.    Main  Questionnaire  Question  61E 
asks  students  how  much  time  they  spend  on  homework  for  all  other 
subjects;  the  relatively  high  rate  of  blanks  may  i imply  register  the 
experience  of  sotte  stud?nts  who  nv>v  not  have  other  courses  with 
homework  besides  those  mentioned  previously.    As  further  evidence,  Main 
Questionnaire  Question  56B  registered  a  higher  percentage  of  blanks 
than  any  of  the  final  fifteen  items,  with  14.8  percent  cf  the  students 
leaving  the  question  blank. 

Given  the  comparison  of  items  at  the  beginning  and  end  of  the 
survey  instruments,  and  the  aforementioned  distribution  of  blanks  in 
the  concluding  section  of  the  questionnaire,  it  seems  the  questionnaire 
is  neither  overly  long  nor  burdensome  for  students.    Still,  tho 
possible  reduction  in  the  time  allotted  for  completion  of  the  survey  in 
the  base  year  must  be  considered  during  the  development  of  the  ,ase- 
year  instruments. 

3.2.7      Cross-validation:    Student  Versus  Parent  Reports 
3.2.7.1      Socioeconomic  Status 

Socioeconomic  status  has  long  been  recognizee;  as  oi.e  of  the  irost 
important  predictors  of  educational  outcomes  and  personal  and  social 
development.    Because  of  the  centrality  of  the  SBS  variable  to 
descriptive  and  analytic  studies,  it  is  extremely  important  that  data 
quality  support  the  construction  of  a  reliable  and  valid  SES  measure. 
Elsewhere  in  this  chapter  (3.2.3.1)  we  analyzed  student  nonresponse;  on 
the  parental  occupation  and  education  questions.    While  this  analysis 
made  clear  that  '  e  level  of  student  nonresponse  was  disturbingly  high 
on  wl^ese  items,  .c  left  unanswered  the  question  of  the  quality  of 
responses  actually  given.    One  way  to  gange  the  ouality  of  student  SES 
responses  is  to  compare  them  to  parent  responses.    Parents  in  general 
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will  presumably  know  their  own  educational  attainments  and  occupational 
statuses— and  usually  those  o*  their  spouse— better  than  will  an  eighth 
grader . 

Among  the  composite  variables  included  in  the  data  files  for  both 
and  "»S4B  is  an  SES  Index.    Bach  participant  was  assigned  a  code 
corresponding  to  one  of  four  quart iles,  based  on  the  SES  composite 
acore.      Pive  components,  standardised  then  equally  weighted,  were  used 
to  compute  the  respondent's  SES  sco.-.    These  were:  father's 
education,  mother's  education,  parent-'  income,  father's  occupation, 
and  household  items.    A  somewhat  different  scheme  was  followed  iu 
constructing  an  SES  composite  for  the  NELS:88  field  test  respondents. 

Pot  purposes  o£  comparing  student  and  parent  SES  reports,  we 
constructed  an  SES  Index  from  a  standardized,  equally  weighted 
combination  of  father's  education,  mother's  education,  father's 
occupation,  and  mother  s  occupation.    Income  was  omitted  because 
there^was  no  income  question  on  the  student  questioroaire.  "Household 
items    was  omitted  because  there  was  no  household  items  question  on  the 
parent  questionnaire.  (However,  we  have  compared  SES  Index  results  with 
student  household  items  reports  and  parent  incone  reports.) 

It  c^ems  most  useful  to  compare  student  composite  to  parent 
composite— as  contrasted  to  comparing  each  SES  item  separately— for 
several  reasons.    Since  SES  has  several  asnects  each  of  which  is  likely 
to  influence  future  achievement  it  a  particular  way,  it  seems 
appropriate  to  represent  rhe  most  salient  of  rlie  family  background 
factors— parental  occupation  and  sducatico— in  a  combined  measure. 
Also,  a  composite  variable  can  accommodate  a  certain  number  of  missing 
values,  and  still  produce  a  valid  classification— whereas  the 
cumulative  effects  of  missing  values  are  not  apparei)    from  looking  at 
the  data  elem.nts  separately. 

Another  motive  for  dealing  with  composite  SES  is  that  the 
cumulative  effect  of  errors  a.*--  have  a  different  effect  than  those 
errors  considered  in  isolation.    For  example,  a  crosstabulation  will 
tell  us  when  parent  occupation  or  eduction  categories  do  not  match  and 
student  responses  can  be  recorded  as  pr^.-med  to  be  either  correct  or 
incorrect.  But,  because  in  a  composite  variable  multiple  errors  may 
c—cel  each  other  and  because  errors  have  different  weights,  composites 
may  often  agree  even  where  a  comparison  of  specific  data  points  shows 
disagreement.    In  a  hierarchically  ordered  measure,  such  as  education 
or  occupation,  correctness  is  not  necessarily  categorical  but  may  admit 
of  degrees.    A  student  who  describes  his  surgeon  mother  as  an 
operative"  rather  than  a  "professional"  makes  a  large  error,  but  a 
student  who  puts  a  parent  in  the  clerical  category  who  in  fact  belongs 
in  sales  makes  an  error  with  smaller  consequences  for  the  assignment  of 
S2S*.  ,Pin*llY»  the  occupational  categories  themselves  cover 
sufficiently  wide  rai\jes  as  to  overlap  for  SES  purposes.    Thus  a 
technical  classification  error— for  example,  classifying  a  high-income 
sale:  representative  who  deals  with  nuclear  medicine  machines  as  a 
manager    may  give  a  truer  SES  datum  than  the  technically  correct 
classification,  sales. 
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We  have  therefore  based  our  central  comparison  on  the  composite 
SBS  variable.     However,  and  in  part  as  a  check  on  this  procedure,  we 
first  crosstabolated  parent  and  student  responses  to  the  four  data 
elements  of  the  composite,  it  her's  occupation,  mother's  occupation, 
father  s  education,  mother's  education.    We  will  report  the  results  of 
the  parental  education  tabulation  summarily,  then  illustrate  the 
results  of  the  occupation  comparison  in  detail. 

Owing  to  the  large  amount  of  missing  data,  only  393  of  the  775 
parent  cases  could  be  matched  to  student  reports  on  the  father's 
education  (recall  that  student  nonresponse  on  the  education  questions 
was  over  thirty  percent,  while  the  two  items  in  the  parent 
questionnaire  had  12.5  and  16  percent  nonresponse  respectively).  Of 
those  393  matchable  responses,  232  agreed  on  father's  education  and  161 
(41  pe~.er.t)  disagreed.    Por  mother's  education,  420  of  the  775 
potential  pairs  could  be  matched.    Some  240  agreed  and  180  disagreed 
(43  percent).    These  results  are  not  encouraging.    While  student  error 
could  be  somewhat  mitigated  by  broadening  the  educational  attainment 
categories,  >he  high  utilization  of  the  Don't  Know  category  sugge  ,ts 
that  botn  nonresponse  and  inaccurate  guessing  would  persist. 

In  order  to  somewhat  simplify  the  comparison  of  pai  it-student 
occupational  reports,  we  have  combined  some  occupations  that  have 
similar  Duncan  SEI  -scores  (for  esample,  craftsman  and  farmer;  cleric*! 
and  sales;  owner,  protective  service;  operative,  service;  professional 
1  and  professional  2),  and  have  dropped  homemaker  and  military,  since 
these  do  not  measure  SES  diffe-ences.    Por  much  the  same  reason,  we 
also  excluded  the  Not  Working  response,  which  '.s  applicable  to  a 
variety  of  situations  that  have  no  one  consistent  meaning  for  SES. 

This  recode  has  the  effect  of  reducing  the  amount  of  disagreement 
be twee j  parent  and  student  reports,  intofar  as  some  contredictions  are 
"»!lified  when  larger  categories  are  drawn.    However,  this  more 
generous  criterion  for  disagreement  is  also  appropriate,  to  the  degree 
tf.at  categories  similar  in  prestige  point  toward  similar  S  S.  Tables 
J"??*/^  ?~293  b*l0w  comPare  »tudent  question  13A  with  parent  question 
1-35P/37P  (adjusteo  for  sex  of  respondent)  and  show  occupation 
category,  number  of  parents  disagreeing  with  the  student  response  and 
percentage  disagreeing  for  both  father's  and  mother's  occupation.  For 
both  father's  occupation  and  mother's  occupation,  the  degree  of 
correspondence  between  child's  report  and  parent's  is  only  56  and  54 
percent  respectively. 
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TABLE  3-29A 

PARENT  DI  SACRKEMENT  WITH  STUDENT 
REPORT  ON  PATERNAL  OCCUPATION 


OCCUPATION 

TOTAL 

DISAGREE 

PERCENTAGE 

LABORER 

30 

13 

432 

OPERATIVE,  SERVICE 

53 

23 

401 

PARMER,  CRAFTS PERSON 

80 

34 

431 

0WNP2,  PROTECTIVE  SERVICE 

49 

14 

291 

CLERICAL     QAT PC 

90 

28 

56Z 

TECHNICAL 

22 

14 

64Z 

TEACHER 

2 

0 

OZ 

MANAGER,  ADMINISTRATOR 

92 

32 

35Z 

PROFESSIONAL  1  AND  2 

57 

18 

32Z 

TOTAL: 

440 

176 

44Z 

TABLE  3-29B 

PARENT  DIbAGREEKENT  WITH  STUDENT 
REPORT  ON  MATERNAL  OCCUPATION 


OCCUPATION' 

TOTAL 

DISAGREE 

PERCENT 

LABC  R 

5 

3 

60Z 

OPERATIVE,  SERVICE 

44 

22 

501: 

FARME4,  CRAFTS PERSON 

12 

10 

83Z 

OfcNER,  PROTECTIVE  SERVICE 

20 

8 

40Z 

.CLERICAL,  SALES 

155 

64 

41Z 

TECHNICAL 

9 

4 

44Z 

TEACHER 

30 

10 

33Z 

MANAGER,  ADMINISTRATOR 

51 

32 

62Z 

PROFESSIONAL  1  AND  2 

63 

25 

407. 

TOTAL: 

389 

173 

46Z 
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One  crveat  in  interpreting  the  paternal  occupation  results  is  that 
many  students  do  not  live  with  their  natural  fathew  and  the  parent  and 
child  nay  not  assign  the  same  referent  to  the  term  "your  father"  and 
"your  spouse".     Nevertheless,  only  a  quite  small  percentage  of 
students  are  separated  from  their  natural  aethers,  and  disagreement  on 
the  maternal  occupation  question  is  nearly  as  extensive  as  on  paternal 
occupation.     Needless  t.  remark,  this  lack  of  agreement,  presumed  to 
reflect  student  error,  is  quite  large— and  larger  still  if  one 
considers  the  extremely  high  rate  of  nonresponse  (predominantly 
Ailtiple  response  and  Don't  Know)  that  persisted  despite  an  in-school 
edit  of  the  occupation  questions.      However,  we  have  argued  that  a 
sounder  comparison  can  be  made  by  utilizing  a  composite  SES  variable. 
He  therefore  took  the  four  reports  (mother's  occupation,  father's 
occupation,  mother's  education,  father's  education),  standardized  each 
on  a  scale  of  1-9,  summed  then,  and  divided  by  the  number  of  non- 
missing  values  (up  to  four).    Then,  on  the  basis  of  the  student  SES 
distributions,  we  divided  these  scores  intv  three  groups,  corresponding 
to  high,  medium,  and  low  SB*.    Finally,  the  three-group  SES  composites 
constructed  from  parent  and  scudent  data  were  crosstabulated.  The 
results  appear  in  Table  3-30  below.    Some  625  parent-student  cases  (out 
of  775  parent  cases  on  the  data  tape)  couU  be  matched  on  this  basis. 

TABLE  1-30 

P* RENT -REPORTED  VS.  STUDENT  REPORTED  COMPOSITE  SES 


Parent  Report — > 


LOU 


MIDDLE 


Row 

HIGH  Tot. 


Student  Report  f 


LOW 


192 


52 


247 


MIDDLE 


54 


200 


25 


279 


HIGH 
Col.  Total 


7 

253 


32 

28  '* 


60 
88 


99 

625 


The  effects  of  missing  e'ata  have  been  minimized  by  drawing  on  multiple 
data  elements — in  81  percent  (625)  of  the  775  potentially  matchable 
cases  it  was  possible  to  construe  parental  SES.    Of  the  unmatchable 
cases,  none  are  unmatchable  owing  to  parent  item  nonresponse — all 
parents  could  supply  at  least  one  SES  datum,  and  54  percent  supplied 
all  four  as  did  35  percent  of  the  students.  (Of  course  it  should  also 
be  remembered  that  while  all  parents  will  be  included  in  the  base  /ear 
survey,  it  is  likely  that    fewer  parents  than  itudents  will  actually 
participace. ) 

Overall,  we  see  that  parents  confirm  student  reports  of  low  SES 
77.7  percent  of  the  time,  that  they  confirm  student  reports  of  middle 
SES  71.7  percent  of  the  time,  and  corroborate  student  reports  of  high 
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SES  60.6  percent  of  the  time.    It  is  also  likely  that  missing  data  are 
more  common  for  students  in  the  lower  SES  range,  thus  mitigating  the 
apparent  tendency  of  reports  to  show  better  agreement  at  the  lower 
ranges  of  the  SES  scale.    However,  even  vithin  this  broad  tripartite 
representation  of  socioeconomic  strata,  parents  disagree  with  student 
composite  SBS  reports  approximately  28  percent  of  the  time  and  this 
seems  unacceptably  high.      in  addition,  much  of  the  student  occupation 
and  education  data  are  missing  (multiple  response,  Don't  Know, 
illegitimate  blank  or  refusal)  even  after  a  critical  edit. 

In  our  earlier  commentary  on  occupation  and  education  item 
nonresponse  in  the  student  questionnaire,  we  remarked  on  the 
relationship  between  age  and  abilit    to  supply  SES  data.    Hovever,  both 
our  own  field  test  results  and  other  research  suggests  an  important 
qualification  to  this  generalization.    That  is  that  younger  students 
have  a  much  greater  capacity  to  name  and  describe  parental  occupat;ons 
than  to  perform  closed-coded  classifications  of  occupations.  Wc 
examined  a  subsample  of  student  and  parent  questionnaires  from  eight 
schools  and  determined  that  our  own  occupation  coding  based  on  the 
student's  open-ended  responses  had  a  low  level  of  agreement  with  the 
occupation  categories  chosen  by  the  student.  When  we  constructed  SES 
out  of  an  alternative  measure  (the  student  household  items  question)  we 
found  that  it  had  a  better  correlation  with  the  parental  SES  composite 
than  with  the  student  SES  composite.    (Household  Items  SES  also  had  a 
better  correlation  with  SES  as  represented  by  parent  income  than  with 
the  SBS  composite  dratm  from  student  reports.)    Other  researchers  have 
found  (Colfax  and  Allen,  1967;  Kerckhoff,  Mason,  and  Poss  1973;  St. 
John,  1970)  that  younger  adolescents  can  usually  name  and  describe 
parental  occupacions— or  deal  successfully  with  lists  of  household 
items — but  have  difficulty  using  pre-coded  occupation  categories. 
Younger  pupils1  responses  to  precoded  questions  are  thought  to  result 
in  information  loss,  validity  problems,  and  high  status  bias. 

It  is  therefore  our  recommendation  that  the  precoded  occupation 
questions  (question  13  in  the  student  questionnaire)  appear  only  on  the 
parent  questionnaire.  Parents  can  answer  questions  about  their  own 
educational  and  occupational  background  with  considerable  accuracy. 
Asking  only  parents  to  use  the  occupation  categories  would  remove  from 
che  student  instrument  a  lengthy  question  series  that  takes  much  time, 
engenders  considerable  frustration  and  th&t  both  quantitatively  and 
qualitatively  fails  to  produce  needed  SES  data.  (It  is  also  a  question 
series  that  takes  a  good  amount  of  the  in-school  editor's  time—time 
that  couL-*  be  better  spent  ensuring  the  quality  of  other  items.)  If 
question  13  were  dropped,  the  length  of  the  questionnaire  could  then  be 
somewhat  reduced,  or  more  v.  luable  questions  asked  instead. 

If  this  recommendation  were  to  be  implemented,  one  problem  immediately 
portends .    SES  is  a  critical  datum,  and  if  the  parent  did  not  participate, 
there  would  be  no  occupation  data  from  which  to  construct  the  SES  Index. 
Nevertheless,  some  student  SES  items  would  remain  on  the  questionnaire- 
household  items  and  rooms  in  the  home,  questions  which  have  comparatively 
low  nonresponse  (2-6  percent)  and  which  may  be  more  reliable  SES  indicators 
than  eighth  graders1  occupation  reports.  (Also,  parental  education  questions 
couU  remain,  since  these  take  far  less  time  to  do— although  nonresponse  for 
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these  itens  was  greater  then  30  percent.)    In  a  few  extreme  cases,  SES 
information  might  not  be  obtained  until  the  First  Follow-Up. 

While  simply  dropping  the  occupation  question  is  one  option, 
another  is  to  retain  the  open-ended  version  of  the  occupation  question 
(37A-E)-- which  students  can  generally  answer  reasonably  well.  We 
suggest  using  the  parent  version  of  the  open-ended  occupation  question 
in  the  student  questionnaire  also,  suitably  simplified  (by  deleting 
slashes  and  simplifying  the  time  reference  of  the  question)  for  the 
eight  grade  audience.    If  this  question  is  retained,  it  should  be 
moved—with  due  attention  to  not  disrupting  the  flow  of  current  items — 
to  the  locator  book.    Alternatively,  it  could  be  printed  on  a  tear-out 
page.    If  this  were  done,  an  occupational  coder  could  produce  an 
accurate  restatement  of  the  SBS  data  in  terms  of  the  standard 
occupation  classifications.  Such  coding  has  not  been  budgeted.  In 
order  to  keep  coding  expenditures  at  an  absolute  minimum,  the  open- 
ended  occupation  questions  could  be  held  in  reserve,  to  be  used  if  and 
only  if  a  parent  SBS  report  were  lacking.      Parents  generally  had  far 
higher  response  rates  on  the  occupation  items  (1-35F,  1-37F)  than 
students ,  even  though  they  were  not  designated  as  critical.    By  making 
the  occupation  and  eduacation  questions  critical  items  in  the  parent 
questionnaire  and  investing  in  additional  retrieval,  the  number  and 
quality  of  parent  occupation  reports  could  be  maximi  ed. 

A  final  option  would  be  to  include  the  open-ended  occupation 
question  on  the  student  instrument  and  code  all  responses,  regardless 
of  whether  the  parent  provided  the  needed  SBS  reports.    This  option  is 
unattractive  for  two  reasons.    It  would  be  very  expensive — and  while 
this  large  occupational  coding  investment  would  certainly  provide  trcre 
data,  those  additional  data  points  would  be  gathered  from  the  second- 
best  respondent,  the  eighth  grade  student. 

3.2.7.2      Early  Educational  Experience 

In  examining  high  nonresponse  items  on  the  student  questionnaire, 
we  found  that  one  data  element  in  question  56  had  the  highest 
nonresponse  of  any  item  in  the  instrument  (56E,  Did  you  attend  extended 
day?;,  while  other  items  from  the  series  also  had  problematic  response 
rates.    This  same  series  of  questions  is  also  asked  of  parents  (3-1), 
with  the  student  as  the  point  of  reference  co  the  parent  questions. 
Since  students  appear  to  have  problems  with  some  of  these  questions — 
which  are  about  very  early  instructional  and  pre-instructional 
programs — it  is  important  to  ask  whether  parents  can  better  supply  such 
data.    We  compare  student  and  parent  responses  below* 
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TABLE 

3-3 1A 

/ 

CROS STABULATION  0?  STUDENT  05 6A 
VS.  P'^ENT  Q3-1D:    ATTENDED  KINDERGARTEN 

Q.3-lD—> 

YES 

NO 

DK 

Row 
Total 

Q.56A  YES 
1 

V  NO 

559 

51 

3 

613 

18 

21 

39 

DK 

4 

2 

6 

Col.  Total 

581 

74 

TABLE 

3 

3-3  IB 

658 

CROS STABULATION 
VS.  PARENT  Q3-1A: 

OE  STUDENT  Q5t>B 
ATTENDED  DAY  CARE 

Q.3-lA—> 

YES 

NO 

DK 

Row 
Total 

Q.56B  YES 
| 

121 

64 

185 

V  NO 

48 

255 

3 

306 

DK 

19 

52 

71 

Col.  Total 

188 

371 
TABLE 

3 

3-3 1C 

562 

CROS  STABULATION 
VS.  PARENT  Q3-1B:  ATTENDED 

OE  STUDENT  Q56C 

NURSERY  SCHOOL  OR  PRESCHOOL 

Q.3-lB—> 

YES 

NO 

DK 

Row 
Total 

Q.56C  YES 
1 

316 

49 

1 

366 

V  NO 

42 

154 

2 

197 

DK 

23 

28 

51 

Col.  Tot»l 

380 

231 

3 

614 

ERJ.C 

154 

102 

* 

TABLE  3-31D 


CROSS TABULATION  OP  STUDENT  Q56D 
VS.  PARENT  Q3-1C:    ATTENDED  HEAD  START 

Row 


Q.3-1C— > 

YES 

NO 

DK 

Total 

Q.56D  YES 
1 

32 

31 

63 

V  NO 

18 

311 

7 

336 

DK 

17 

98 

3 

118 

Col.  Total 

67 

440 

10 

517 

TABLE  3-31E 

CROSSTAB ULATION  OP  STUDENT  Q56E 
VS.  PARENT  Q3-1E:    ATTENDED  EXTENDED  DAY 

Q.3-1E— > 

YES 

NO 

DK 

Row 
Total 

Q.56E  YES 
1 

18 

14 

2 

34 

V  NO 

27 

299 

13 

339 

DK 

21 

119 

5 

J  45 

Col.  Total 

66 

432 

20 

518 

We  see  from  the  above  crosstabulations  that  there  is  a  fair  amount 
of  disagreement  between  parents  and  students  on  these  items.  Perhaps 
even  more  striking  is  the  high  degree  of  student  uncertainty  about  some 
of  the  Items,  and  the  capacity  of  parents  to  answer  those  items  to 
which  the  student  h&s  responded  Don't  Know.  Overall,  parents  used  the 
Don't  Know  option  36  times.    Students  in  this  analysis  (that  is,  those 
whose  parent  had  also  participated)  used  Don't  Know  395  times,  over  ten 
times  more  often.  Parents  were  generally  able  to  give  answers  where 
students  had  opted  for  Don't  Know—in  56B,  for  example,  ell  71  of  the 
student  Don*t  Knows  have  been  answered  yes  or  no  by  parents;  for  56C, 
^11  51  student  Don*t  Knows  are  ai.Jwered  yes  or  no  by  parents;  in  56D, 
115  of  118  student  Don't  Knows  were  resolved  by  parents,  and  in  56E, 
140  of  145.    Other  forms  of  nonresponse,  such  as  illegitimate  blanks, 
are  also  far  higher  for  students  than  their  parents.    All  in  all,  it 
appears  that  parents  are  better  data  sources  for  questions  about  early 
childhood  instructional  and  pre-instructional  programs  than  are 
students.    The  parent  questionnaire  should  be  regarded  as  the  primary 
source  for  these  items.    The  items  may  also  be  asked  of  students,  in 
order  to  obtain  a  second  best  source  if  the  parent  does  not  respond, 
provided  that  this  inclusion  is  not  at  the  expense  of  valuable 
questions  for  which  the  student-  is  the  b-   .  information  source. 
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However,  we  •trongly  recommend  that  category  E~extended  day— be 
dropped  fro.  both  questionnaires.    That  neither  set  of  respondents  was 
sure  of  the  meaning  of  "extended  day"  is  attested  to  by  the  high  rate 
of  both  student  (39  percent)  and  parent  (25.1  percent)  nonresponse. 
IFor  those  who  do  answer,  the  response  is  overwhelmingly  negative.) 

3.2.8     Scale  Reliabilities 

This  section  concerns  two  attitude  scales— internal  versus 
external  locus  of  control  (question  25,  items  S,  C,  F,  G,  H,  K,  M,  0, 
Q)  and  self-esteem  (question  25,  items  A,  D.  E,  I,  J,  L,  N,  P,  R,  s). 

Paper  IV,  "Considerations  on  Values  and  Attitudes,"  in  the  series 
of  Position  Papers  on  NELS:88,  issued  in  August  of  1985  just  before 
release  of  an  RPP  for  the  project,  made  two  main  recommendations 
concerning  attitude  scales  for  the  student  questionnaire.  One 
recommendation  concerned  the  njmber  of  scale  items  that  should  be  used 
and  the  other  concerned  the  need  for  personal  rather  than  general 
reference  in  locus  of  control  it< 


The  reason  additional  items  were  recommended  was  to  meet  the  goal 
Sre1^1'"*!1118  ,Cal"  reliabilitie«-  The  position  paper  observed  that  in 
NLS-72  and  HSAB,  competition  for  space  had  sometimes  reduced  attitude 
scales  to  three  or  four  items  each,  too  few  to  achieve  robust 
reliabilities.    In  modifying  the  High  School  and  Beyond  locus  of 
control  and  self-concept  composites  for  NELS:88  eighth  graders,  we 
therefore  took  the  opportunity  to  add  additional  items  to  each  scale. 

In  fact,  High  School  and  Beyond  had  12  items  on  internal  versus 
ex  mal  locus  of  control  and  self-esteem,  although  only  eight  of  these 
were  used  to  form  the  two  four-item  composite  variables  for  self 
concept  (BB058A,  -C,  -D,  and  -H)  and  locus  of  control  (BB058B,  -E,  -F 
and  -G),  scales  that  were  strictly  equivalent  to  those  of  NLS-72.  We 
took  the  eight  items,  and  three  of  the  four  remaining  items.    We  made 
minor  changes  in  these  items  so  that  they  could  be  understood  by 
typical  eighth  graders    (For  example,  "I  take  a  positive  attitude 
toward  myself"  was  changed  to  "I  feel  good  about  myself")    and  added 
seven  items  for  a  final  focal  of  nineteen.    We  also  modified  items  so 
that  tney  would  refer  directly  to  the  respondent  (for  example,  "Good 
luck  is  more  important  than  hard  work  for  success"  was  changed  to  "in 
my  life,  good  luck  is  more  important  than  hard  worn  for  success"),  >nd 
tried  to  correct  the  response  set  bias  on  the  locus  of  control  scale. 

There  are  two  reasons  for  scrutinizing  the  performance  of  these 
attitude  items  especially  closely.    One  is  that  the  two  scales  in  their 
Sfe8'^  f0rn  ar6'  33  indicated  above,  importantly  different  from  the 
NLS-72 /HS&B  scales— untesced  items  have  been  added  and  items  have  been 
rewritten.    In  addition,  even  without  these  changes,  it  would  be 
necessary  to  examine  the  performance  of  these  scales  with  eighth 
Crsders.  While  an  important  goal  is  to  improve  on  the  reliabilities 
achieved  in  the  earlier  longitudinal  studies,  movng  from  twelfth  and 
tenth  graders  to  eighth  grade  is  likelv  to  n,ake  obtaining  nigh 
reliabilities  all  the  harder. 
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The  two  scales  were  not  designated  critical  items  in  the  field 
test.    The  response  frequencies  indicate  a  very  high  level  of  response 
for  the  nineteen  items  that  comprised  the  scales ,  ranging  from  over  99 
percent  (25A)  tof  at  worst,  97.2  percent  (250)— only  two  of  the 
nineteen  Items  had  nonresponse  rates  above  two  percent. 

A  measure  of  reliability    hat  is  routinely  applied  to  scales  and 
tests  is  Cronbach's  alpha  or  coefficient  alpha.  Coefficient  alpha  is 
essentially  a  measure  of  the  internal  consistency  and  repeatability  of 
a  measure.    In  addition  to  computing  coefficient  alpha,  some  analysis 
packages  (including  SPSS-X,  which  we  utilised  for  reliability  analyses) 
also  give  statistic*  for  the  item-to-total  correlation  and  the  alpha  if 
the  item  is  deleted.    Thus  o«e  can  identify  those  items  that  make  a 
small,  no,  or  even  negative  contribution  to  the  overall  reliability  of 
the  scale,  as  well  as  assess  which  items  contribute  most  to  achieving  a 
reliable  scale.    While  we  would  noK  feel  confident  predicting,  from  a 
non-probability  sample  of  1376  students,  the  levels  of  scale 
reliability  that  would  be  achieved  with  a  probability  sample  of  over 
26,000  students,  the  field  te*t  sample  is  highly  suitable  for  use  in 
appraising  the  effectiveness  of  individual  scale  items. 

Again,  with  the  qualification  that  the  field  test  does  not  allow 
us  to  generalize  to  probable  coefficient  alphas  for  the  two  scales  in 
the  base  year,  it  is  nevertheless  interesting  and  quite  possibly 
instructive  to  examine  the  results  of  the  reliability  analysis. 
Overall,  the  reliability  coefficient  alpha  for  the  self-esteem  scale 
was  .S2,  and  for  the  locus  of  control  scale  .60 — although  alpha  for  the 
latter  scale  could  have  been  raised  to  .63  by  deletion  of  the  weakest 
item.    Por  comparison  purposes,  the  reliability  coefficient  alpha  for 
the  HS&B  and  NLS-72  scales  was  somewhat  lower — .66  for  the  self-esteem 
composite  and  .56  for  locus  of  control  (Kolstadt,  in  Position  Paper 
IV). 


When  further  statistics  for  the  self-esteem  scale  are  examined,  we 
see  that  deletion  of  any  item  would  lower  the  alpha,  although  the  most 
dispensable  item  would  be  25E  (MI  am  able  to  do  things  as  well  as  most 
other  people19),  which  has  an  itc  a-to-total  correlation  of  only  .377  end 
adds  little  to  the  reliability  (alpha  if  item  deleted  is  .816).  (This 
is,  however,  an  HS&B/NLS-72  item  that  was  used  in  the  composite 
variable.)  The  most  indispensable  items  are  25L  (MAt  times  I  think  I  am 
no  good  at  all" — HS&B  onlv,  not  used  in  the  composite),  25A  ("I  feel 
good  about  myself"— HS&B/NLS72,  used  in  composite),  and  25S  ("All  in 
all,  I  pretty  much  feel  that  I  am  a  failure" — new  item)  with  item-to- 
total  correlations  of  .571,  .571,  and  .570  respectively).  Our 
recommendation  is  that  this  scale  not  be  changed. 

When  further  statistics  for  the  locus  of  control  scale  are 
examined,  we  see  that  (as  in  HS&B  and  NLS-72)  it  works  somewhat  less 
satisfactorily  than  the  self-esteem  scale.    The  highest  item  to  total 
correlation  is  .493,  for  item  25G  (MMy  plans  hardly  ever  work  out,  so 
planning  only  makes  me  unhappy"— from  HS&B/NLS-72,  used  in  composite), 
and  three  items  have  poor  correlations — 25H  ("I  try  to  accept  my 
condition  in  life,  rather  than  try  to  change  things"— HS&B/NLS-72 ,  used 
in  composite)  at  .178,  25K  ("I  have  a  big  influence  over  the  things 
that  happen  vo  me"— new  item)  at  .180,  and  250    ("What  happens  to  me  is 
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my  own  doing"— HS4B  only)  at  .067.    In  the  correlation  matrix,  250  had 
weak  negative  correlation!  with  25B,  25C,  and  25H.    If  the  weakest 
item~250y-wer«  deleted,  the  alpha  would  increase  to  .629.    If  25H  were 
deleted,  it    -mid  like  I  tiny  (third  decimal)  contribution  to  the 
alpha.    For  all  other  items,  deletion  would  decrease  coefficient  alpha. 
Item  250  was  taken  from  HS&D— however,  it  was  not  used  in  the  composite 
locuf  of  control  scale*    We  recommend  that  it  be  deleted  from  the  base 
year  questionnaire  for  NELS:88.    Although  25H  apparently  does  not 
contribute  to  the  scale,  it  might  be  advisable  to  keep  it  because  it 
was  used  in  the  HS&B/NLS-72  composite.    However,  note  that  25H  is  an 
item  with  which  internals  must  disagree  while  250  is  an  item  with  which 
they  must  agree.    To  delete  250  without  deleting  an  item  (like  ?.5H) 
with  which  internals  must  disagree  (or  externals  agree)  makes  the 
disagree  items  too  dominant  in  the  scale  a--<  risks  creating  a  response 
set  bias.    (However,  the  chances  of  creating  a  response  set  may  be 
lessened  because  items  for  each  of  the  scales  are  interspersed.)  It 
may,  then,  be  advisable  to  write  a  new  item  for  this  scale,  with  which 
those  having  an  internal  locus  of  control  would  agree.    Of  course  if 
this  were  done,  there  would  be  no  further  opportunity  to  statistically 
evaluate  the  performance  of  that  item  prior  to  the  base  year  itself. 

3.2.9      Item  Response  Variation  by  Selected  Student  Classification 
Variables 

While  we  have  analyzed  nonresponse  on  the  item  level,  we  have  not  addressed 
the  question  of  the  extent  to  which  item  nonresponse  may  vary  by  respondent 
characteristics.      Pronounced  variations  in  nonresponse  that  correlate  with 
common  or  defining  features  of  groups  of  respondents  have  possible  implications 
for  the  evaluation  and  revision  of  the  student  questionnaire.    For  this  reason, 
we  have  crosstabulated  item  response  with  a  variety  of  standard  student 
classification  variables.    This  analysis  can  yield  several  kinds  of  important 
findings. 

It  is  of  interest,  for  example,  to  know  whether  nonresponse  is  a  problem  for 
particular  groups  of  people.    Do  the  same  people  tend  to  reappear  as  the 
nonrespondents  on  a  variety  of  items,  or  on  some  particular  type  of  item—or  is 
nonresponse  highly  item-specific  and  randomly  distributed  throughout  the 
respondent  population?    If,  for  example,  those  at  h:  Jier  risk  for  dropping  out— 
and  let  us  say  that  low  SES,  plus  low  grades  and  low  assigned  track  are 
reasonable  predictors  of  school  noncompletion — are  systematically  high  in  item 
nonresponse,  and  are  more  likely  to  fail  to  answer  both  locator  and  main 
questionnaire  items,  this  may  have  implications  for  how  these  items  should  be 
written,  or  whether  special  data  supplementation  efforts  are  required  for  this 
identifiable  high  item-nonresponse  group. 

Such  analyses  also  may  add  to  our  understanding  of  the  causes  of 
item  nonresponse,  and  point  to  particular  problems  in  question  wording 
or  format.    For  example,  if  item  performance  varies  with  respondent 
characteristics,  this  may  indicate  that  a  particular  item  has  a  less 
clear  meaning  to  one  group  than  to  another.    Many  group-related 
differences  in  response  to  items  can  be  mitigated  by  question 
rewording,  but  even  when  this  is  not  the  case,  it  is  necessary  to  be 
aware  of  the  possible  effect  of  group- associated  item  nonresponse  on 
the  reliability  of  estimates.    The  fact  that  the  NELS:88  field  test 
data  so  richly  characterize  the  respondent  population  across  a 
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considerable  range  of  home  and  school-related  factors  provides  a 
substantial  opportunity  for  enlarging  our  understanding  of  i  em 
nonresponse  in  a  student  questionnaire. 

Eleven  questions  were  chouen  for  further  analysis  to  discover 
underlying  relationships  which  might  further  elucidate  the  nonresponse 
observed.    Questions  were  chosen  on  the  basis  of  the  theoretical 
interest  which  saae  of  the  classif icatory  variables  might  have  for  the 
question  and  the  chance  that  theoretical  considerations  might  lead  to 
refinements  in  the  questions.  Consideration  was  also  given  to 
representing  different  types  (both  in  terms  of  form  and  content)  of 
questions.    Thus  the  selection  represents  both  reports  of  respondent 
behavior  and  reports  on  parental  behavior  and  expectations,  Locator 
Book  and  Main  Questionnaire  items,  and  "circle  one"  and  "circle  all 
that  apply"  formats.    All  but  one  of  the  items  (56A)  were  problematic 
variables,  with  nonresponse  of  eight  percent  or  higher.  Crosstabs  were 
ruu  using  respondent's  sex,  race,  ethnicity,  school  sector,  school 
urbanicity,  SBS  by  parent  report,  grades  by  self-report,  pattern  of 
early  language  acquisition,  and  academic  track  as  independent  variables 
for  each  of  the  questions. 

3.2.9.1     Analysis  Procedure 

Student  responses  to  Locator  Question  10  were  used  to  determine 
sex.    Main  Questionnaire  question  2  was  used  to  determine  race;  Black, 
White,  and  Other  were  the  racial  categories  utilized.    Ethnicity  was 
taken  from  Main  Questionnaire  question  1,  the  "Other  Hispanic"  and 
Other  Asian-Pacific  Islander"  categories  *.re  not  utilized  because 
earlier  field  test  analyses  had  demonstrated  that  there  was  a  high 
level  of  error  in  responses  to  these  categories^    Ethnicity  is  actually 
a  breakdown  into  Hispanic,  Asian-Pacific  Islander,  and  Other. 

School  sector  was  taken  from  the  Quality  Education  Data  (QED)  tape 
used  during  the  contacting  stage,  and  schools  were  classified  as  either 
Public,  Catholic,  or  Other  Private.    School  sector  was  not  a 
statistically  significant  differentiating  factor  for  any  of  the 
questions  analyzed.    Similarly,  the  urbanicity  classification  was 
derived  from  QED  data  used  at  the  contacting  stage,  and  schools  were 
classified  as  urban,  suburban,  or  rural.    SES  was  derived  from  student 
report  of  parental  education  and  occupation.    Future  analysis  will 
examine  these  same  questions  on  the  basis  of  a  subsample  of  students 
for  which  we  have  parent?!  versions  of  SES. 

Student  grades  by  self-report  were  taken  from  Main  Questionnaire 
question  63.    Students  were  grouped  into  high,  medium,  and  low  grades. 
Students  indicating  that  they  received  mostly  As  were  coded  as 
receiving  high  grades;  students  indicating  they  received  about  half  As 
and  half  Bs,  mostly  Bs,  and  about  half  Bs  and  half  Cs  were  coded  as 
receiving  middle  or  average  grades,  while  students  indicating  that  they 
received  lower  grades  were  coded  as  receiving  low  grades.  Early 
language  acquisition  was  taken  from  student  responses  to  Locator 
Question  16,  which  asked  students  whether  or  not  they  had  spoken  a 
language  other  than  English  prior  to  entering  school. 
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Academic  track  was  determined  by  student  responses  to  Main 
Questionnaire  questions  43A,  43B,  43C,  and  43D.    A  scale  was  developed 
which  utilised  all  nonmissing  data  students  in  tracking  environments 
provided,    The  scale  was  recoded  into  three  groups  according  to 
theoret.  ^al  considerations,  such  that  students  with  half  or  more  than 
half  of  their  classes  in  the  lowest  track  and  none  of  their  classes  in 
the  highest  track  would  be  classed  as  low  track  students.  Students 
with  all  or  threa  out  of  four  of  their  classes  i.i  the  highest  track, 
and  none  of  theit  classes  in  the  lowest  track,  would  be  classed  as  high 
track  students.    Students  with  other  patterns  of  track  assignment  would 
typically  fall  into  the  middle  track. 

Some  of  the  independent  variables  have  important  theoretical 
inter-relationships  which  have  not  been  treated  in  this  analysis. 
Although  the  limited  sample  size  does  not  permit  much  in  the  way  of 
multivariate  analyses,  cursory  examination  of  those  inter-relationships 
will  be  included  in  the  final  draft. 

3.2.9.2  Pindings 

Part  one  of  Table  3-32  below  lists  the  content  of  the  eleven 
questions  chosen  while  part  two  of  Tabl^  3-32  marks  the  independent 
variables  which  produced  differences  in  performance  for  different 
groups  significant  at  or  below  the  .05  level.    An  "x"  marks  those  at  or 
below  the  .05  level  of  significance,  an  "o"  marks  those  at  or  below  the 
.01  level  of  significance.    Questions  are  grouped  in  terms  of  question 
content.    Each  question  will  be  discussed  in  turn  with  regards  to  each 
of  the  statistically  significant  independent  variables.    All  questions 
were  high  nonresponse  questions  except  Question  56A,  included  as  a 
point  of  comparison  for  Questions  56B,  56C,  56D,  and  56E. 


TABLE  3-32 


PART  ONE:    CONTENTS  OP  QUESTIONS 


Locator  Question  13 


What  type  of  program  does  the  high  school  the 
student  expects  to  attend  have? 
In  what  type  of  high  school  program  will  the 
student  enroll? 

Have  the  students  parents  phoned  or  spoken 
with  teachers  or  counselors  this  academic 
year? 

What  are  the  father  or  male  guardian's 
educational  aspirations  for  the  student? 
What  are  the  mother  or  female  guardian's 
educational  aspirations  for  the  student? 
Has  the  student  been  given  aptitude  tests? 
Did  the  student  enroll  in  kindergarten? 
Did  the  student  enroll  in  day  care? 
Did  the  student  enroll  in  nursery  school  or 
preschool? 

Did  the  student  enroll  in  Head  Start? 
Did  the  student  enroll  in  Extended  Day? 


Question 


28 


Question 


18B 


Question 


27A 


Question 


27B 


Question 
Question 
Question 
Question 


33 
56A 
56B 
56C 


Question 
Question 


56D 
56E 
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Out St  Ion 
Fut  un 
School 
Program: 

Loc  Q  13 

Question  28 

Parental 

Contact 
with  School: 

Question  18B 

Parental 
Asp1 rat  1 ons 
for  Student 
Educat Ion : 


Question  27A 
Question  27B 


Aptitude 
Test  1 ng: 


Question  33 


Pre-f <rst 
grade  school 
experl ence: 


Question  56A 
Question  56B 
Question  56C 
Quest  1  or  56D 
Question  56E 


TABLE  3-32  (CON'T) 


Sex 


None 
None 


SES 


Rac*      Ethnl c      Track        Grades        S      P        Urban  Lang 


x  o  o 

o 


o 

o 


o 

x  o 
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Out  of  one  hundred  ten  possible  statistically  significant 
difference*,  only  thirty-three  are  observed.  (Under  a  more  stringent 
criterion  of  significance--*:. 01--that  number  drops  to  21,  or  19.1 
percent  of  the  potential  number.)  Including  the  sector  of  the  school, 
which  did  not  produce  any  statistically  significant  differences  in 
performance,  fully  seveaty-seven  situations  exist  which  did  not  produce 
statistically  significant  differences.    Thus,  tnis  selective 
examination  of  the  field  test  data  would  seem  to  suggest  that 
nonresponse  is  more  or  less  evenly  distributed  throughout  the  student 
population  except  for  a  few  situations  discussed  below. 

Only  two  statistically  significant  differences  in  performance  are 
observed  on  the  basis  of  sex  and  the  student  version  cf  SES,  while  four 
are  observed  on  the  basis  of  SES  as  calculated  from  Parent  data.  Race, 
track,  and  urbanicity  each  account  for  six  of  the  statistically 
significant  differences,  and  the  pattern  of  these  differences  suggests 
that  these  three  independent  variables  may  be  somewhat  related. 
Indeed,  of  the  eighteen  statistically  significant  differences 
collectively  accounted  for  by  race,  track,  and  urbanicity,  fully  half 
(9)  occur  in  three  situations  in  which  all  three  are  statistically 
significant.    It  is  worth  noting  that  in  two  of  those  three  instances, 
grades  also  produced  statistically  significant  differences.  In 
addition,  race  and  track  both  produced  statistically  significant 
differences  in  one  case,  and  race  and  urbanicity  produced  statistically 
significant  differences  in  two  cases.    Differentiation  on  the  basis  of 
race  never  produced  a  statistically  significant  difference  in 
performance  that  was  not  accompanied  by  either  a  difference  on  the 
basis  of  academic  track  or  of  urbanicity,  though  academic  track  was 
unaccompanied  by  urbanicity  and  race  twice,  and  urbanicity  w&j 
unaccompanied  by  race  and  track  once. 

3.2.9.3    Item-by-Item  Analysis 

Locator  Question  13  —  Race,  Ethnicity,  Track,  Grades,  SES  (Parent), 
Language 

locator  Question  13  asks  students  about  the  program  of  the  high 
school  they  expect  to  attend  in  tenth  grade.    Levels  of  nonresponse 
were  high  for  all  groups.    The  levels  of  nonresponse  observed  for 
different  groups  provides  further  evidence  that  the  terms  used  in  the 
question  are  not  clear  to  many  students. 

The  differences  observed  for  track  and  grades  are  as  predicted  by 
theory.    Students  with  higher  grades  by  self-report  and  students  in 
higher  tracks  register  lower  nonresponse  rates  than  their  counterparts 
on  Locator  Question  13.    Below,  in  Table  3-33,  the  nonresponse  rates 
for  each  of  the  rhree  groups  is  provided: 
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TABLE  3-33 


Nonresponse  Rates 
High  Track 
21. 81 

Middle  Track 

32  .4% 

Low  Track 

42.11 

Total 

31. 5Z 


Nonresponse  Rates 
25.  OZ 
31. 1Z 
50. OZ 
30. 8Z 


High  Grades 
Middle  Grades 
Low  Grades 
Total 


This  item  is  very  sensitive  to  track,  and  less  sensitive  to  grades.  It 
should  be  noted  that  student  track  is  constructed  from  student-provided 
data  and  is  therefore  subject  to  a  degree  of  nonresponse  bias.  Thus, 
the  nonresponse  of  the  low  track  students  may  be  even  worse  than 
indicated  by  the  data  available,  if  the  low  track  students  evidenced  a 
rate  of  nonresponse  to  the  tracking  questions  similar  to  that  observed 
in  other  questions. 

To  increase  the  overall  response  rate  and  the  response  rate  of  low 
track  students  and  students  with  low  grades,  we  recommend  providing 
more  explanatory  information  in  the  answer  categories  available. 

Question  18B  —  Track 

Question  18B  asked  students  whether  or  not  their  parents  had 
phoned  or  spoken  to  teachers  or  counselors  during  the  current  academic 
year.    As  expected,  nonresponse  was  lower  for  the  higher  track 
students.    High  track  registered  a  nonresponse  rate  of  9.1  percent,  the 
middle  track  registered  a  rate  of  13.3  percent,  and  the  low  track 
registered  a  nonresponse  rate  of  26.9  percent. 

The  relative  performance  of  students  on  this  question  may  or  may 
not  be  related  to  different  school  experiences.    It  seems  doubtful  that 
the  wording  of  the  question  is  the  cause  of  student  difficulty  on  this 
item.    Question  18B  is  reproduced  below: 

18.  Since  the  beginning  of  this  school  year,  has  either  of  your  parents 
or  guardians  done  any  of  the  following: 

(CIRCLE  ONE  ON  EACH  LINE) 


Yes 


b.  Phoned  or  spoken  to 
your  teacher  or 
counselor  


No 


I  don't  know 


The  language  of  the  question  does  not  seem  to  be  too  difficult  for 
students  to  handle.    Thus,  no  recommendation  is  suggested  for  altering 
th^  text  or  lormatting  of  the  question. 
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Question  27A  —  Race ,  SES  (Student),  SES  (Parent),  Urbanicity 


Question  27A  asked  students  about  the  father  or  male  guardians 
educational  aspirations  for  the  student.    The  relative  nonresponse 
rates  observed  for  different  groups  is  probably  related  to  the 
different  experiences  of  the  students  rather  than  the  wording  or 
subject  matter  of  the  question.    For  example,  the  relatively  high 
nonresponse  rate  for  Blacks  on  this  question  may  be  related  to  the 
greater  incidence  of  single  parent  female-headed  households  among 
Blacks.    If  this  is  the  case,  presumably  no  alteration  in  the 
questionnaire  will  correct  the  missing  data  problem. 

Given  that  the  basis  of  the  differences  in  nonresponse  rates  for 
different  groups  is  probably  based  upon  their  differing  experiences,  no 
adjustment  in  the  question  is  recommended. 

Question  27B       Race,  Track,  Grades,  Urbanicity 

Tabl*  3-34  below  compares  student  performance  on  Question 
27A,  discussed  above,  to  studerV-  performance  on  Question  27B.  Question 
27A  asks  students  how  far  in  school  their  fathers  or  male  guardians 
want  them  to  go,  while  Question  27B  asks  students  how  far  in  school 
their  mothers  or  female  guardians  want  them  to  go: 


TABLE  3-34 


Nonresponse  Rates 

Races  Question  27A  Question  27B 
Blacks                           32. OZ  20. 7Z 

Whites  23. 2Z  13. 7Z 

Others  27. 9Z  22. 1Z 

Total  25. 8Z  16. 7Z 

It  does  not  seem  plausible  that  most  of  the  nonresponse    n  Question  27A 
is  related  to  the  absence  of  the  father  or  male  guardian,  given  the 
lower  but  still  high  levels  of  nonresponse  for  all  racial  groups  on  the 
similar  question  (Question  27B)  for  the  mother  or  female  guardian. 
Thus,  the  differences  observed  for  different  groups  may  have  as  much  to 
do  with  the  presence  of  guardians  as  it  does  with  the  role  those 
guardians  play  in  planning  the  educational  career  of  the  student.  If 
this  is  the  case,  nonresponse  again  is  less  related  to  the  wording  and 
foraat  of  the  question  and  more  related  to  the  differing  experience  of 
students.    This  information  is  of  itself  an  important  datum  for 
researchers.    Given  that  differing  nonresponse  rates  are  probably  not 
related  to  question  wording  or  format,  we  recommend  that  the  item  be 
retained  as  it  is. 


Question  28  —  Track,  Grades,  SES  (Student),  SES  (Parent) 

Question  28  is  similar  to  Locator  Question  13,  asking  students  in 
which  type  of  high  school  program  they  will  enroll,  and  as  such  is 
prone  to  many  of  the  same  difficulties  which  attend  to  Locator  Question 
13.    Nothing  in  the  analysis  of  Question  28  contradicts  the  findings  jf 
the  analysis  of  Locator  Question  13;  indeed,  the  analyses  evidence  a 
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high  degree  of  similarity.    Thus,  the  recommendations  provided  for 
Locator  Question  13,  namely,  that  more  explanatory  text  be  provided  for 
each  of  the  available  answer  categories,  are  also  made  for  adjustment 
of  Question  28. 

Question  33  —  Race,  Urbanicity 

Question  33  asked  students  whether  or  not  they  had  taken  any 
aptitude  tests.    Again,  differences  in  the  experience  of  students  may 
have  affected  their  ability  to  answer  the  question.    For  example, 
differences  in  program  availability  and  incidence  of  testing  may  have 
affected  the  differential  nonresponse  rates.    Still,  some  degree  of 
nonresponse  is  attributable  to  the  wording  of  the  question.    Thus,  we 
recommend  providing  more  explanatory  information  for  students  to  enable 
them  to  recognise  aptitude  tests  which  they  may  have  taken  in  the  past. 

Question  56A  —  Sex,  Race,  Track,  SBS(Parent),  Urbanicity 

Question  56A  was  included  as  a  point  of  comparison  for  Questions 
56B,  56C,  56D,  and  56E.    Question  56A  asks  students  whether  or  not  they 
wert  enrolled  in  kindergarten.    Differences  in  performance  were 
observed  for  this  question  concerning  student  experience  or 
nonexperience  with  kindergarten.    The  nonresponse  rates  for  each  of  the 
independent  variables  are  listed  below  in  Table  3-35: 


TABLE  3-35 


Sex 


Male 
Female 


Nonresponse  Rate 

7.2Z 
2.4Z 


Race 


Black 
White 
Other 


9.4Z 
3.2Z 
5.7Z 


SES- (Parent) 
High 
Middle 
Low 


2.2Z 
2.4Z 
7.0Z 


Track 


High 

Middle 

Low 


Nonresponse  Rate 

3.4Z 
5.6Z 
17. 3Z 


Urbanicity 

Urban  7.8Z 

Suburban  4.5Z 

Rural  2.0Z 


The  largest  variation  in  nonresponse  rates  is  between  high  track  and 
low  track  students.    This  may  be  related  to  difficulties  inherent  in 
the  question  wording  or  it  may  be  .elated  to  differing  experiences  for 
high  and  low  track  students.    Overall,  however,  rhe  nonresponse  rate 
for  the  question  is  not  high;  this  question  is  included  as  a  point  cf 
comparison  for  the  questions  which  ask  about  other  types  of  pre-first 
grade  student  experiences. 

Quescion  56B  —  Sex,  Urbanicity 

Question  56B  asks  students  whether  or  not  they  were  in  day  care. 
Once  again,  differences  in  the  experience  of  students  in  urbar, 
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suburban,  and  rural  settings  may  explain  the  diferences  in  nonresponse 
rates.    If  possible,  extra  explanatory  text  might  prove  helpful,  but 
one  is  hard-pressed  to  find  more  illuminating  terms  for  day  care  which 
would  be  meaningful  for  an  audience  of  eighth-graders.    Thus,  no  formal 
recommendation  is  made. 

Question  56C  ~  Race,  Track,  Grades,  Urbanicity,  Language 

Question  56C  asks  students  whether  or  not  they  were  enrolled  in 
nursery  school  or  preschool.    Nonresponse  has  two  main  sources:  1) 
memory  difficulty  and  2)  differing  experiences.  Students 
understandably  encounter  difficulty  in  trying  to  recall  whether  or  not 
the  activity  which  they  attended  on  a  daily  basis  at  the  age  of  three 
was,  indeed,  nursery  scnool.    In  addition,  differences  observed  for 
sub-groups  are  probably  based  in  differential  experiences.  For 
example,  because  this  question  seeks  to  measure  student  participation 
in  pre-first  grade  programs,  the  differences  in  nonresponse  rates 
observed  on  the  basis  of  language  minority  status  may  simply  be  related 
to  the  greater  incidence  of  students  born  in  nations  othe^  than  the 
United  States  in  the  language  minority  category.    Students  born  in 
other  nations  may  not  have  moved  to  the  United  States  at  a  young  enough 
age  to  experience  nursery  school  or  preschool;  thus,  the  question  may 
confuse  them  because  they  have  not  been  exposed  to  the  term  or  the 
experience. 

Question  56D  and  Question  56 E  —  None 

Question  56D  asks  students  whether  or  not  they  were  enrolled  in 
Head  Start,  while  Question  56E  ask«  students  whether  they  were  enrolled 
in  Extended  Day.    It  is  important  to  note  that  none  of  the  independent 
variables  distinguished  significant  differences  in  the  nonresponse 
rates  for  these  two  questions.    Rather  than  indicating  that  the  two 
questions  are  performing  equally  well  for  all  groups,  this  information 
indicates  that  the  items  are  performing  at  a  relatively  static  and 
decidedly  poor  level  for  all  sub-populations.    Significant  differences 
in  performance  owing  to  track,  grades,  urbanicity,  race,  SES,  or  sex 
might  point  toward  a  sub-group  which  found  the  two  questions  less 
difficult,  and  thereby  point  toward  a  way  in  which  the  question  might 
be  adjusted  to  become  relevant  for  a  broader  audience.    At  the  very 
least,  relative  success  in  dealing  with  these  questions  for  one  sub- 
group might  be  a  basis  for  retaining  the  two  questions,  on  the 
reasoning  that  across  all  similar  items  some  types  of  students  may  have 
had  and  remembered  exposure  to  the  items  represented  in  questions  56D 
and  56E,  and  therefore  treatment  of  all  items  together  would  be  useful 
to  an  analyst  devising  a  measure  of  pre-first  grade  organized  school 
experience.      Field  test  data  suggest  that  Questions  56D  and  especially 
56E  do  not  contribute  in  this  manner  to  such  a  measure.    Thus,  we 
recommend  removing  Question  56E  from  the  base-year  student 
questionnaire. 

3.2.9.4  Conclusions 

For  many  of  the  high  nonresponse  items,  the  differences  in 
nonresponse  rates  for  groups  were  statistically  significant  even  though 
no  group  evidenced  adequate  ability  to  answer  the  question.  Instead, 


the  differences  observed  simply  provided  further  evidence  that 
question*  which  create  difficulty  for  all  students  might  be  more 
difficult  for  students  in  lower  academic  tracks  or  with  lower  grades 
than  for  students  in  higher  academic  tracks  or  with  higher  grades. 
Data  also  suggest  that  high  track  students  and  students  with  high 
grades  are  not  bored  by  the  level  of  the  questionnaire,  given  their 
better  performance  on  high  nonresponse  items.    In  every  situation, 
students  performance  was  better  the  higher  the  academic  track,  and  the 
same  relationship  was  observed  concerning  grades  by  student  self- 
report. 

Ethnicity  and  language  use  in  feneral  seem  uncorrelated  with 
nonresponse.    However,  in  Question  U,  a  specialized  terminology  is 
Msed  that  is  unfamiliar  to  substantial  number*  of  mainstream  students. 
Specialized  vocabularies  present  even  greater  problems  for  language 
minority  students. 

Urbanicity  may  be  close  ^  tied  to  other  variables  which  have 
already  been  discussed,  or  some  questions  may  indeed  have  differential 
meanings  depending  upon  the  student's  experience,  differences  that  may 
be  traced  to  an  urban/ suburban/rural  difference. 

One  surprising  finding  is  that  few  significant  differences  are 
observed  between  different  SES  groups.    This  is  a  positi-  *  finding,  and 
suggests  that  efforts  to  devise  a  document  with  a  minima;  level  of  bias 
was  successful  to  some  degree.    Still,  if  high  nonresponse  is 
associated  with  low  SES  and  SES  is  developed  from  data  in  the  student 
questionnaire,  then  the  data  used  to  develop  the  SES  measure  is  also 
prone  to  the  damaging  effects  of  nonresponse.    This  must  be  taken  into 
consideration  in  the  revision  of  the  base  year  documents, 

In  sum,  judging  from  a  limited  nunber  of  high  nonresponse  items, 
it  appears  that  respondent  characteristics  d;a  not  have  a  strong  and 
pervasive  effect  on  item  performance  in  the  ^ield  test  student 
questionnaire.    The  evicencj  supports  our  finding,  reported  in  section 
3.2.6,  concerning  item  ncn-  sponse  by  item  position  in  the 
questionnaire.    However,  analysis  of  nonresponse  over  the  course  or  the 
entire  questionnaire  seems  to  indicate  that  some  statistically 
significant  differences  in  performance  are  observed  for  different 
groups,  partir  ilarly  on  the  basis  of  academic  track,  race,  and  grades. 
Still,  when  attentic  >  is  focused  on  a  selection  of  items  with  the 
highest  nonresponse,  statistically  signifi:ant  relationships  between 
response  a  d  theoretically  important  classification  variables  are 
observed  less  often  than  not.    Where  such  differences  are  observed,  it 
is  usually  more  plausible  to  see  differential  nonresponse  as  more  a 
function  of  genuine  lack  of  knowledge—of  the  differential  experience 
and  answering  ability  of  the  respondent  groups— than  as  evidence  of 
lack  of  clarity  in  item  wording  or  questionnaire  format  and  logic. 
Nevertheless,  a  few  of  the  observed  relationships—track  is  the  most 
dramatic  example  of  this,  with  a  statistically  significant  (at  .01) 
relationship  seen  on  six  of  the  eleven  items—are  disturbing.    It  may 
indeed  be  that  low  track  students  are  dramatically  less  aware  of 
parent-teacher  communications  'Q.  id)  than  high  track  students.    If  so, 
nonresponse,  as  an  indicator  of  this  lack  ot  awareness  is  an  important 
datum  in  itself.    But  no  analyst  should  forget  that  item-level 
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nonreaponse  can  be,  just  as  school-  and  individual -level  nonresponse,  a 
biasing  fact or •    The  fact  that  respondent  characteristics  appear  to  seldom 
have  a  major  effect  on  item  performance  makes  it  all  the  more  important  to 
be  aware  of  the  exceptional  cases  where  they  may  indeed  have  such  an  effect. 

3.3     The  Cognitive  Test  Battery 

3.3.1    Introduction  and  Background 

The  Educational  Testing  Service  (ETS)  was  contracted  by  OERI  to 
develop  the  NELS:88  test  battery  in  order  to  assess  students'  cognitive 
growth  during  their  transition  from  grade  eight  to  grade  twelve.  The 
long  term  goal  of  the  NELS  longitudinal  study  is  to  estimate  the  extent 
and  correlates  or  cognitive  growth  in  four  cognitive  areas.    The  four 
cognitive  areas  are: 

•  Reading  or  Literacy 

•  Mathematics 

•  Science 

•  Social  Studies 

In  addition  to  measuring  growth  and  its  educational  antecedents,  a 
secondary  purpose  of  the  NELS  test  battery  is  to  provide  a  common  scale 
such  that  comparable  HS&B  cohorLS  can  be  comp^~ed  on  a  cross-sectional 
basis  with  the  NELS  cohort  in  the  area  of  mathematics  and  possibly 
reading.    US&B  1980  to  1982  Sophomore  to  Senior  gains  in  mathematics  and 
possibly  reading  can  be  contrasted  with  the  comparable  NELS  cohort  gains 
taking  place  between  1990  and  1992. 

In  order  to  better  understand  the  NELS  longitudinal  testing  design,  it 
would  be  useful  to  contrast  the  goals  and  procedures  of  a  large  scale 
cross-sectional  design  such  as  NAEP  with  those  of  a  longitudinal  design  such 
as  NELS.    Both  test  batteries  (NAEP  and  NELS)  are  subject  to  relatively 
severe  limitations  with  respect  to  the  amount  of  testing  time  that  is 
available.    Within  these  testing  time  limitations  NAEP  attempts  to  assess 
performance  in  a  number  of  content  areas  at  both  the  total  score  and  at  the 
subscore  level  when  possible.    NAEP  can  be  thought  of  as  an  assessment 
procedure  analogous  to  a  thermometer  which  takes  the  Nation's  educational 
temperature  in  a  number  of  content  areas  and  at  various  stages  of  student 
development.    Because  of  testing  time  limitations  and  the  fact  that  NAEP 
will  be  attempting  to  develop  subscores  for  various  cross-classifications  of 
content  by  cognitive  process,  the  measurement-  relxability  of  these  subscores 
will  be  relatively  low.    However,  they  will  still  be  sufficiently  reliable 
for  computing  scores  such  as  means  aggregated  across  the  total  sample 
receiving  a  particular  subset  of  the  measures.    Students  in  the  NAEP 
administration  receive  only  a  sublet  of  the  measures  in  order  to  maximize 
the  number  of  content  areas  that  are  covered  in  a  specific  administration. 
Since  the  particular  block  of  measures  a  student  receives  is  assigned  in  a 
random  fashion,  the  aggregate  (mean)  scores  based  on  this  particular  block 
of  items  and  students  can  be  assumed  to  be  an  unbiased  estimate  of  the  total 
student  population's  performance.    This  balanced  incomplete  block  testing 
design  enables  the  NAEP  researchers  to  inform  policy  makers  about  the 
average  performance  of  the  nation's  students  in  a  particular  content  area. 
However,  since  a  relatively  small  proportion  of  the  total  NAEP  sample 
receives  a  given  block  or  content  area,  estimates  of  student  performance  for 
finer  cross-classifications  of  students  can  be  relatively  unstable. 
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Cross-sectional  trends  in  averages  can  also  be  estimated  but  the  policy 
interpretations  are  subject  to  all  the  usual  qualifications  about  using 
cross-sectional  data  to  draw  longitudinal  inferences. 

A  longitudinal  study  such  as  NBLS  attempts  to  inform  policy  makers 
about  questions  having  to  do  with  how  much  change  occurred  and  why 
studerta  have  changed  or  gained  in  performance  over  time.    In  order  to 
deal  with  this  type  of  policy  questions  longitudinal  studies  need  to  be 
more  "high  fidelity'1  than  cross-sectional  designs  given  the  same  amount 
of  testing  time.    High  fidelity  as  used  here  simply  means  measuring  fewer 
things  with  greater  accuracy.    Lower  fidelity  designs  such  as  NAEP  measure 
many  things  with  somewhat  less  reliability.    This  lower  fidelity  design  is 
appropriate  for  NAEP's  primary  purpose— the  reporting  of  aggregate  scores 
without  too  fine  a  breakdown.    Obviously  if  testing  time  were  not  limited 
(as  are  budgets  and  the  patience  of  the  nation's  school  systems)  these 
compromises  would  not  be  necessary.    Another  way  to  describe  the 
longitudinal  design  in  NELS  is— fewer  things  each  being  measured  on  many 
students  while  NAEP  would  be  best  described  as  many  things  each  being 
measured  on  fewer  students. 

Longitudinal  studies  of  gain  require  more  reliable  measurement  since 
they  attempt  to  correlate  diffarences  in  school  processes  at  the 
individual  level  with  corresponding  differences  in  gains  in  achievement 
at  the  individual  level.    One  attempts  to  correlate  differences  between 
the  educational  processes  received  by  Jane  and  Johnny  with  differences  in 
their  amounts  of  achievement  gains.    In  summary,  the  balanced  incomplete 
block  design  as  used  in  NAEP  is  less  appropriate  for  NELS  since  having  large 
samples  receive  more  items  is  necessary  in  NELS  type  "individual  difference" 
models  in  order  to: 

t  Maintain  sufficient  accuracy  at  the  individual  score  level  to 

reliably  estimate  correlates  of  gain, 
t  Allow  for  finer  cross-classifications  in  order  to  investigate 

vhether  the  educational  process  works  the  same  for  different 

kinds  of  individuals. 

One  potential  drawback  of  longitudinal  designs  that  operate  within  a 
limited  amount  of  testing  time  is  that  it  is  difficult  to  estimate 
subscores  within  a  given  test  that  have  sufficient  reliability  for  change 
measurement.    Rather  than  give  up  the  notion  of  having  interpretable 
subscores  in  a  longitudinal  design,  we  propose  a  slightly  different  approach 
co  calibrating  and  scoring  the  tests  that  will  yield  subscores  with 
sufficient  reliability  for  change  measurement  given  certain  assumptions  of 
unidimensionality. 

Basically  this  approach  assumes  that  within  the  total  test  there  are 
clusters  of  items  (testlets)  that  are  internally  homogeneous  with  respect 
to  difficulty  level  and  that  can  be  used  to  behaviorally  anchor  the  total 
score  scale.    In  order  to  behaviorally  anchor  the  scale  these  testlets 
should  form  a  hierarchy  of  skill  levels.    For  example,  in  Mathematics  the 
lowest  skill  level  might  be  a  testlet  of  items  describing  single 
operation  arithmetic  on  whole  numbers.    The  next  skill  level  could  be  a 
cluster  of  items  describing  arithmetic  problems  requiring  multiple 
operations,  etc.    This  approach  is  similar  to  that  u^ed  in  developing  the 
NAEP  behaviorally  anchored  reading  scale  except  that  we  prefer  to  use 
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clusters  of  items  to  mark  a  scale  point  because  of  the  e  danced 
reliability  of  clusters  over  single  items.    This  procedure  "ties"  the 
test  scores  to  a  given  level  of  proficiency  and  thus  provides  diagnostic 
information  about  any  given  examinee's  performance.    Statements  can  be  made 
about  what  percentage  of  any  given  population  is  operating  at  a  particular 
proficiency  level,  say,  mastery  of  arithmetical  operations  on  whole  numbers. 

This  behaviorally  anchored  scaling  procedure  (Rock  &  Pollack,  1987)  has 
been  developed  and  applied  to  the  HS&B  mathematics  items  and  has 
demonstrated  significant  improvement  ovtr  the  traditional  measures  of 
change.    The  application  of  this  procedure  to  the  HS&B  Mathematics  test  is 
described  in  detail  (see  List  of  Appendices).    In  the  case  of  the  HS&B 
mathematics  items, the  hierarchically  ordered  scales  provided  diagnostic 
information  on  the  skill  levels  that  showed  the  greatest  changes  as  well  as 
demonstrating  signif icaivtly  stronger  relationships  between  change  and  school 
processes. 

It  is  quite  conceivable,  in  fact  likely,  that  more  than  one 
hierarchical  model  could  fit  the  data*    In  addition  to  the  model 
described  above,  which  is  primarily  a  curriculum  sequence  model  of 
development,  other  hierarchical  models  could  be  posed  that  would  include 
clusters  describing  low  level  arithmetic  operations,  and  then  a  more 
difficult  cluster  that  required  an  application  of  all  the  simple  lower  level 
operations  plus  some  additional  reasoning  skills.    The  latter  two-level 
hierarchy  might  be  fitted  separately  for  different  mathematics  content 
areas*    Similarly  in  the  reading  area,  performance  on  clusters  of  items 
requiring  only  vocabulary  skills  and  attention  to  detail  might  mark  the 
lowest  proficiency  scale  point.    The  next  higher  skill  level  cluster  would 
require  not  only  proficiency  in  the  vocabulary  but  also  require  the  ability 
to  make  inferences  fiom  t:he  passage.    Because  familiaritv  of  content  is  so 
important  in  reading  for  comprehension,  it  may  be  desirable  to  develop 
hierarchical  clusters  withi  ;  those  content  areas  having  sufficient  items  to 
form  the  clusters.    It  is  anticipated  that  both  the  mathematics  and  the 
reading  item  pool  may  furnish  sufficient  items  to  form  clusters  that  in  turn 
have  desirable  scale  properties  and  diagnostic  interpretations.  The 
preliminary  field  test  results  suggest  that  the  above  models  may  be  less 
appropriate  for  the  Science  and  Social  Studies  areas. 

*  The  following  sections  present  and  discuss  the  preliminary  results 
of  the  field  test  in  some  detail. 

3.3.2    Pretest  Sample  Design 

The  pretest  sample  included  1,376  students  at  51  schools  with  an  8th 
grade;  1,131  students  at  30  schools  with  a  10th  grade,  and  1,017  students  at 
30  schools  with  a  12th  grade.    The  sample  was  drawn  from  5  states;  New  York, 
California,  Florida,  Illinois,  and  Texas. 

Two  pretest  forms  were  constiucted — Form  A  and  Form  B.    Form  A 
included  the  preteat  items  for  the  Reading  and  the  Science  test.    Form  B 
included  the  Mathematics  items  and  the  Social  Studies  items.    Table  3-36 
below  shows  the  number  of  pretest  items  in  each  content  area  and  the  test 
administration  times. 
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TABLE  3-36 


NUMBERS  OF  PRETEST  ITEMS  AND  THE 
TEST  ADMINISTRATION  TIMES 


Cognitive  Area  Number  of  Items  Administration  Time 

Reading  (Form  A)  SO  55 

Science  (Form  A)  42  30 

Mathematics  (Form  B)  82  60 

Social  Studies  (Form  B)  60  25 


The  two  test  forms  were  spiralled  within  each  grade  leve?..    That  is,  half  of 
the  students  at  each  grade  level  received  Form  A  and  the  other  half  received 
Form  B.    Since  tests  were  nested  under  forms,  this  amounted  to  spiralling 
tests.    A  total  of  1599  students  across  all  three  grade  levels  took  Form  A 
(Reading  and  Mathematics).    The  Form  A  totals  included  700  eighth  graders, 
470  tenth  graders,  and  429  twelfth  graders.    Similarly,  1,812  students  took 
Form  B  (Mathematics  and  Social  Studies).    The  Form  B  totals  included  667 
eighth  graders,  599  tenth  graders,  and  546  twelfth  graders.    While  these 
numbers  fell  somewhat  short  of  the  original  target  numbers,  i.e.,  600  on 
each  form  within  each  grade,  it  is  felt  that  the  sample  srze  is  still 
sufficient  to  estimate  the  necessary  item  parameters  and  select  the  items  to 
be  included  in  the  final  forms. 

Table  3-37  below  shows  the  percent  cf  examinees  that  completed  the 
tests  by  grade  level. 

TABLE  3-37 

PERCENT  OF  EXAMINEES  COMPLETING  EACH  TEST  BY  GRADE  LFVEL 


Test  Content  Grade  8  Grade  10  Grade  12 

Social  Studies  97  97  98 

Mathematics  87  92  89 

Reading  98  99  98 

Science  95  95  94 
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The  percent  of  the  pretest  sample  completing  each  test  ranged  from 
87  percent  of  the  students  in  the  8th  grade  on  the  Mathematics  test  to  98 
percent  of  the  students  in  the  12th  grade  on  the  Reading  test.  A  test  is 
considered  relatively  unspeeded  if  approximately  90  percent  percent  of  the 
examinees  complete  the  test.  While  the  Mathematics  did  not  quite  achieve 
the  90  percent  level  of  completion  at  the  8th  and  12th  grade,  it  was  felt 
that  it  was  close  enough  to  be  considered  unspeeded. 

3.1.3      Length  of  Final  Forms 

Based  on  the  number  of  items  and  the  test  timings  used  in  the 
pretest  (Table  3-36)  and  the  completion  rates  shown  in  Table  3-37  above, 
baseline  projections  of  the  desired  test  lengths  of  the  final  forms  can 
be  estimated.    Given  that  the  maximum  amount  of  testing  time  available  is  in 
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Reading-  20  items  administered  in  20  minutes. 
Mathematics-  40  items  administered  in  30  minutes. 
Science-  25  items  administered  in  18  minutes. 
Social  Studies-  30  items  administered  in  12  minutes. 

This  allocation  of  items  and  testing  time  yields  a  total  testing  time  of 
approximately  1  hour  and  20  minutes.    These  projections  take  into 
consideration  projected  reliabilities  of  relatively  unidimensional  test 
content  areas.    These  may  be  somewhat  o      for  potentially 

multidimensional  content  areas  such  as  ^ience  and  Social  Studies.    Just  how 
far  off  these  projections  are  will  become  clearer  in  the  next  section 
dealing  with  the  item  analysis  statistics. 

3.3.4     Selecting  Items  For  Measuring  Change 

in  order  to  arrive  at  efficient  estimates  of  change  scores,  the 
final  forms  should  be  constructed  to  minimize  "floor"  and  "ceiling" 
effects.    Floor  effects  occur  when  test  forms  are  much  too  difficult  for 
a  large  number  of  the  examinees.    When  this  occurs  the  low  ability 
examinees  receive  chance  -scores  on  the  first  testing.    Thus  there  is  no 
discrimination  among  rhe  low  scoring  individuals  at  the  time  one  testing. 
If  the  test  is  still  too  difficult  at  the  time  of  the  second  testing  the 
same  individuals  will  once  again  receive  chance  scores.    In  this  case 
there  will  be  no  discrimination  among  low  ability  individuals  at  time  one 
or  time  two  and  more  importantly  there  will  be  no  reliable  discrimination 
among  examinees  with  respect  to  amounts  of  change.    Estimates  of  mean 
change  for  these  individuals  will  also  be  inaccurate.    If  the  test  only 
has  floor  effects  at  time  one  but  not  time  two  for  low  ability 
individuals  the  situation  is  less  serious.    When  this  occurs  the 
reliability  of  the  individual  score  changes  may  be  attenuated  while  mean 
changes  for  these  individuals  will  be  somewhat  underestimated. 

Ceiling  effects  can  even  be  more  damaging  with  respect  to  estimating 
gains  accurately.    If  the  test  tends  to  have  insufficient  numbers  of  the 
more  difficult  items  on  the  second  and  third  testings,  the  change  scores 
will  be  artificially  constrained  for  high  ability  examinees.  This 
phenomenon  contributes  to  the  typical  finding  of  a  negative  correlation 
between  "raw"  gain  scores  and  the  initial  test  scores.    Given  rather 
limited  amounts  of  testing  time  a  compromise  solution  is  to  develop  test 
forms  that  are  "adaptive"  to  the  ability  level  of  the  examinee.    That  is, 
the  examinee  is  presented  items  that  are  appropriate  for  his  or  her 
ability  level.    This  procedure  tends  to  minimize  the  possibility  of  floor 
and  ceiling  effects  biasing  the  estimates  of  the  score  gains.    This  type 
of  tailored  test  is  best  administered  and  scored  on  a  computer.  The 
level  of  "tailoring"  of  the  item  to  the  ability  of  the  examinee  can  vary 
from  computer-based  completely  adaptive  tests  with  all  examinees 
receiving  different  items  to  mildly  adaptive  test  forms  appropriate  for 
paper  and  pencil • 

Our  approach  here  is  to  build  grade  adaptive  tests  where  necessary. 
Grade  adaptive  tests,  i.e.,  tests  whose  distributions  of  item 
difficulties  vary  by  grade  level  rather  than  at  the  individual  level,  can 

172 

210 


be  administered  in  a  paper  and  pencil  format  under  standardized 
conditions.    Grade  adaptive  tests  should  be  sufficiently  adaptive  to 
minimise  floor  and  ceiling  effects  and  yet  maintain  the  same 
standardisation  of  administration  procedures  as  HS&B  and  NAEP.    This  will 
facilitate  crosswalking  scores  between  the  various  populations  where 
appropriate. 

There  is  no  "free  lunch"  however;  items  uj ed  in  adaptive  tests  must 
be  scalable,  which  in  turn  means  that  they  should  form  a  reasonably 
uni dimensional  item  pool.    This  allows  one  to  put  test  scores  based  on 
different  items  that  are  given  in  the  different  grades  on  the  same  scale 
using  Item  Response  Theory  (IRT)  methods.    Originally  it  was  proposed 
that  Mathematics,  Reading,  and  Science  be  grade  level  adaptive.  The 
requirement  that  the  Social  Studies  test  cover  the  domains  of  American 
History,  Government,  Ethics,  and  Geography  made  it  a  less  likely 
candidate  for  making  it  adaptive  because  of  its  potential 
multidimensionality.    Similarly  the  Science  test  specifications  required 
items  dealing  with  concepts  in  Earth  Science,  Life  Science,  Chemistry  and 
Physics.    In  addition  the  Science  items  :«re  written  to  emphasize  higher 
order  thinking  skills  in  each  of  these  four  knowledge  domains.    While  the 
Science  test  item  pool  may  not  be  unidimensional ,  it  was  designed  by  the 
test  developers  to  deal  with  concepts  which  are  familiar  at  all  three 
grade  levels,  thus  somewhat  mitigating  the  need  to  make  it  grade  level 
adaptive.    While  the  Reading  and  Mathematics  test  item  pools  were  also 
designed  to  measure  higher  order  thinking  skills  in  a  number  of  content 
areas,  past  experience  suggests  that  their  respective  item  pools  will  be 
reasonably  unidimensional  and  thus  amenable  to  building  adaptive  tests. 
The  next  section  discusses  pretest  results  that  bear  on  the 
unidimensionality  of  the  four  test  item  pools. 


3.3.5    Dimensionality  of  the  Pretest  item  Pools 

Factor  analysis  has  been  the  traditional  method  for  analyzing  the 
dimensionality  of  item  pools.    However,  it  is  becoming  more  apparent  that 
in  the  case  of  dichotomous  item  data  linear  factor  analysis  of  Pearson 
(phi)  correlations  does  not,  in  general,  yield  the  correct  number  of 
factors  (see,  e.g.,  Carroll,  1983;  Hulin,  Drasgow,  fit  Parsons,  1983; 
;  Mislevy,  1986).    Extra  factors  associated  with  item  difficulties  rather 

than  content  often  appear.    One  alternative  to  estimating  phi 
coefficients  is  to  compute  tetrachoric  correlations,  but  when  the  items 
can  be  answered  correctly  through  guessing,  factor  analysis  of 
tetrachorics  can  also  produce  spurious  factors  (Hulin,  Drasgow,  and 
Parsons,  1983).    Although  Christof ferson  (1975)  and  Muthen  (1978)  have 
developed  a  generalized  least  squares  method  that  is  appropriate  for 
tetrachoric  correlations,  it  is  limited  to  about  25  items  due  to  heavy 
computational  requirements.    In  general  there  is  no  uniformly  accepted 
statistical  procedure  for  this  problem. 

Fortunately  recent  simulation  work  by  Zwick  (1987)  using  NAEP 
reading  data  casts  some  light  on  the  problem.    Zwick  simulated  a  one 
dimensional  item  pool  using  IRT  procedures.    She  then  used  principal 
components  to  factor  the  matrix  of  Pearson  (phi)  correlations  as  well  as 
two  other  more  sophisticated  methods.    The  other  two  methods,  full- 
information  factor  analysis  (Bock,  Gibbons,  fit  Muraki,  1985)  and  a 
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contingency  table  approach  due  to  Rosenbaum  (1984),  potentially  provide 
solutions  to  this  problem;  but  like  Muthen's  approach,  there  remain  some 
unresolved  computational  problems. 

Zwick  used  the  ratio  cf  the  first  latent  root  to  the  second  latent 
root  in  the  principal  components  analysis  and  found  that  this  ratio  was 
always  greater  than  four  in  all  the  simulations  based  on  unidimensional 
item  data.    The  more  sophisticated  procedures  verified  the 
unidimensional ity  of  the  item  pool.    The  ratio  of  the  largest  latent  root 
to  the  next  largest  root  has  a  certain  intuitive  appeal  since  IRT  scaling 
procedures  only  assume  a  preponderant  first  factor  rather  than  perfect 
unidimensionality.    In  sum,  if  this  ratio  is  greater  than  four  there  is 
some  evidence  for  sufficient  unidimensionality  for  scaling  using  IRT 
procedures.    Unfortunately  if  the  ratio  is  less  than  four  in  a  principal 
component  solution,  it  does  not  necessarily  mean  that  the  pool  is  net 
unidimensional.    For  example,  a  content-homogeneous  item  pool  could  have 
a  bimodal  item  difficulty  distribution  and  thus  yield  two  equal  sized 
factors. 

Our  approach  to  this  problem  is  to  use  the  latent  root  ratio 
criterion  as  evidence  in  support  or  against  the  unidimensionality 
assumption.    If  a  test  item  pool  fails  the  rati'   criterion,  then 
preliminary  IRT  estimation  will  still  te  carried  out  to  investigate  the 
possibility  that  the  failure  was  primarily  due  to  clusters  of  items  at 
multiple  difficulty  levels. 

Table  3-38  presents  the  latent  root  ratios  by  test  and  grade  level. 
It  also  shows  that  the  ratios  of  the  latent  roots  for  Reading  and 
Mathematics  all  meet  the  criterion  of  four  or  more.    Neither  Science  nor 
Social  Studies  meet  the  criterion.  Since  Science  and  Social  Studies  would 
appear  to  be  multi-dimensional  2,  3,  and  4  factors  were  extracted  and 
rotated  using  Varimax.    Inspection  of  the  rotated  loadings  indicated  that 
salient  loadings  on  a  given  factor  shared  little  in  common  from  a  content 
or  process  viewpoint.    See  List  of  Appendices  for  a  presentation  of  the 
rotated  factor  loadings  for  the  Science  and  Social  Studies  four-factor 
solucions  for  the  total  sample. 

Since  no  readily  interpretable  factors  appeared  in  either  analysis, 
the  hypothesis  that  the  multidimensionality  was  primarily  the  result  of 
difficulty  artifacts  could  not  be  rejected.    Since  difficulty  clusters 
would  not  affect  the  estimation  of  IRT  parameters  it  was  decided  to 
proceed  with  a  preliminary  IRT  estimation.    At  this  point  the  IRT 
estimation  is  more  for  confirmation  of  the  unidimensionality  or  lack 
thereof  as  well  as  to  yield  additional  information  on  the  item 
characteristics.    If  the  following  item  analysis  results  suggest  that 
floor  and  ceiling  effects  are  not  a  factor  in  th*.  Science  and  Social 
Studies  test,  then  theie  would  be  no  compelling  reason  to  IRT  scale  them 
since  they  need  not  be  grade  adaptive.    It  was  originally  felt  by  the 
test  construction  committees  involved  that  both  test  item  pools  were 
constructed  such  that  a  single  form  could  be  developed  and  used  at  all 
grade  levels.    Whether  or  not  this  is  the  case  is  investigated  in  the 
next  section. 
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Cognitive 
Area 


Reading 

A2 

Math  Ax 
Math  A2 

Science 
Science  A2 


TABLE  3-38 

THE  LATENT  ROOTS  OF  THE  TWO  LARGEST  FACTORS  AND  THEIR 
RATIOS  BY  GRADE  AND  TESTED  AREA 


Grade  8 


Percent 

of  Ratio 
Root    Variance  Ai/A2 


9.3 
1.6 

11.2 
2.4 

3.7 
1.6 


18.5 
21. 7 

13.7 
16.5 

8.8 
12.5 


5.9 


4.7 


2.3 


Grade  .10 


Percent 

of  Ratio 
Root  Variance  Ai/A2 


10.5 
2.0 

14. S 
2.7 

5.4 
1.6 


21.1 
25.0 

18.1 
21. S 

12.9 
16.8 


5.3 
5.5 
3.4 


Grade  12 


Percent 

of  Ratio 
Root  Variance  Ai/A2 


11.5 
2.0 

16.8 
3.0 

5.1 
1.7 


23.0 
27.0 

20.5 
24.2 

12.1 
16.2 


5.8 
5.6 
3.0 


History 
History  A2 


7.8 
2.5 


13.1 
17.2 


3.1 


7.8 
2.4 


13.1 
17.2 


3.3 


10.4 
2.8 


17.3 
22.0 


3.7 
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3.3.6     Item  and  Test  Analysis 


Tables  3-39  to  3-42  present  the  item  statistics  as  well  as  sunmary 
statistics  for  the  total  item  pool  for  each  test. 

The  proportion  correct  columns  show  the  percentage  of  students  at  each 
grade  level  who  selected  the  correct  answer.    These  percentages  reflect 
the  difficulty  of  the  item  for  examinees  at  each  grade  level.    Items  with 
difficulty  indices  (percent  correct  responses)  between  45  and  65  would  be 
considered  to  be  about  the  appropriate  difficulty  for  the  majority  of  the 
individuals  in  a  given  sample.    The  R-biscrial  columns  show  how  well  each 
item  discriminates  the  high  scoring  examinees  from  the  low  scoring 
examinees.    An  item  is  considered  to  be  a  "good"  item  if  those  examinees 
who  got  it  correct  had  high  scores  on  the  total  item  pool  while  those  who 
got  it  wrong  would  be  expected  to  achieve  low  scores  on  the  total  item 
pool . 

The  IRT  parameters  also  furnish  information  about  the  item 
difficulties  and  level  of  Discrimination.    The  A  parameter  is  the  item 
discrimination  parameter  and  thus  can  be  considered  analogous  to  the 
biserial  except  it  is  on  a  different  scale.    Values  for  the  A  parameter 
between  .5  to  1.0  are  considered  reasonably  discriminating.    Above  1.  is 
considered  a  very  discriminating  item.    The  difficulty  parameter,  B, 
tends  to  run  from  -3.  to  +3.  with  larger  values  indicating  harder  'terns. 
The  B  parameter  is  on  the  same  scale  as  the  examinees'  ability  scores, 
and  corresponds  to  the  ability  level  at  which  50Z  of  examinees  answer  the 
item  correctly.    The  ability  levels  (thetas)  have  a  mean  of  0  and  a 
standard  deviation  of  1  in  the  calibration  sample.    The  C  parameter  js 
the  guessing  parameter  and  it  estimates  the  probability  that  a  person 
very  low  on  the  measured  ability  will  get  the  item  correct.    A  more 
complete  and  somewhat  more  technical  discussion  of  the  IRT  model  can  be 
found  in  the  article  (See  List  of  Appendices). 

The  last  tY>  ~ee  or  four  columns  (depending  on  the  test)  of  each  table 
present  information  on  where  the  item  came  from,  i.e.,  source,  content, 
and  the  cognitive  skill  or  process  assumed  to  be  required  to  solve  the 
item.    These  categorizations  reflect  the  original  test  specifications  and 
the  judgments  of  the  subject  matter  specialist  who  selected  and  or  wrote 
the  items. 

The  column  labeled  "Gain"  is  of  parcicular  interest  since  it 
reflects  the  expected  amount  of  gain  or  improvement  in  the  knowledge 
measured  by  a  given  item  as  one  goes  from  the  8th  to  the  12th  grade. 
Other  things  being  equal,  those  items  that  show  relatively  large  gains 
can  be  considered  to  be  more  sensitive  to  the  growth  taking  place  during 
these  years  of  schooling.    "Other  things  being  equal"  refers  to  the  fact 
that  other  item  characteristics  also  have  to  be  taken  into  consideration 
before  the  final  forms  are  selected.      In  addition  to  having  the 
potential  for  showing  growth,  the  final  items  must  reflect  to  a  certain 
extent  the  content  and  process  specifications,  possess  relatively  high 
reliability  (as  indicated  by  the  biserial  or  A  parameter),  span  the 
difficulty  range  so  that  floor  and  ceiling  effects  are  minimized,  and 
ideally,  contain  enough  HS&B  items  to  allow  for  comparisons  with  earlier 
cohorts. 
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TABLE  3-39 
ITEM  STATISTICS:    RE  AO  INS  TEST 


PROPORTION  CORRECT 


GRADE: 

A 

1  A 
10 

1  9 

1Z 

lUTAl 

GAIN 

N» 

/HO 

tm.  7A 

4Z9 

1  COS 

19  A 

iTEM 

1 

A  OC 

A  OA. 
O  .  TO 

A  AC 

A  Al 
U  .  01 

ITEM 

2 

0.63 

ft    A  A 

0 .69 

gk  ii 
0 . 06 

0 . 06 

ITEM 

3 

A  19 

0 .  oz 

ft  AX 

0  .56 

A  AO 

A  AC 

0  .05 

0 . 06 

ITEM 

4 

0 . 57 

0 . 71 

0 .60 

0.67 

A     9  V 

0 .  Z3 

ITEfl 

5 

0.53 

0 .69 

A  71 

0 . 73 

A    A.  1 

0.63 

0 . 20 

XTEri 

6 

0 .41 

0  .52 

0 .60 

0 .49 

0. 19 

ITEfl 

0.  37 

0.41 

0 .45 

0. 40 

0.06 

ITEfl 

a 

0 . 29 

0  45 

0  .56 

0.42 

0.29 

iTtfl 

9 

0.  34 

0.55 

0.62 

0 . 46 

0.26 

ITEfl 

10 

0 . 36 

0.50 

0.S5 

0.46 

0. 17 

ITEfl 

11 

0  .62 

0  .66 

0.79 

0.66 

0.17 

ITEfl 

12 

0.  36 

0.46 

0.60 

0.46 

0.23 

ITEfl 

13 

0.23 

0.21 

0.22 

0.22 

-0.01 

ITEfl 

14 

0.44 

0.56 

0.66 

0.55 

0.23 

ITEfl 

15 

0.  30 

0.40 

0.42 

0.36 

0.12 

ITEfl 

16 

0.62 

0.74 

0.77 

0.  70 

0. 15 

ITEfl 

17 

0.43 

0.50 

0.55 

0. 46 

0.13 

ITEfl 

16 

0.55 

0.67 

0.71 

0.63 

0 . 16 

ITEfl 

19 

0.63 

0.69 

0 .71 

0  .67 

0.09 

ITEfl 

20 

0.56 

0.67 

0.  70 

0.64 

A     1  * 

0 .  1Z 

ITEfl 

21 

0 .47 

0.56 

0 .60 

0. 54 

0. 13 

ITEM 

22 

0.54 

0.66 

0.67 

0.61 

0.13 

ITEM 

23 

0.  70 

0.77 

0.77 

0. 74 

0.07 

ITEM 

2* 

0.65 

0.60 

0.60 

0.  73 

0. 16 

ITEM 

25 

0.  36 

0.50 

0.55 

0.46 

0.17 

ITEfl 

26 

0.49 

0  63 

0.63 

0.57 

0. 14 

ITEM 

27 

0.25 

0.24 

0.26 

0.26 

0.03 

ITEM 

26 

0.46 

0.62 

0.66 

0.57 

0.21 

ITEM 

29 

0.40 

C.47 

0.54 

0.46 

0.14 

ITEM 

30 

0.41 

0.56 

0.66 

0.53 

0.27 

ITEM 

31 

0.73 

0.62 

0.62 

0.76 

0.10 

ITEM 

32 

0.H6 

0.59 

0.69 

0.57 

0.21 

ITEM 

33 

0  52 

0.63 

0.67 

0.59 

0.15 

ITEM 

34 

0.66 

0.73 

0.75 

0.72 

0.07 

ITEM 

35 

0.63 

0.76 

0.79 

0.72 

0.16 

ITEM 

36 

0.66 

0.79 

0.61 

0.74 

0.15 

ITEM 

37 

0.56 

0.67 

0.72 

0.64 

0.14 

ITEM 

36 

0.60 

0  75 

0.76 

0.66 

0.16 

ITEM 

39 

0.74 

0.75 

0.63 

0.77 

0.10 

ITEM 

40 

0.&4 

0.60 

0.66 

0.60 

0.14 

?15 


PRELIMINARY 


R-BISERI.M. 

IRT  PARAMETERS 

SOURCE 

TV  PC 

CONTENT 

PURPOSE 

6 

10 

12 

TOTAL 

A 

ft 

C 

—■""—•—— 

0 .52 

0.57 

0.49 

0 .51 

0.51 

-4.60 

0.12 

NAEP-R 

NARR 

FOLKTALE 

IM)  AS  51*1 

0. 57 

0.54 

0.66 

0 .60 

0.76 

-1.69 

0.12 

NELS66 

NARR 

FOLKTALE 

UN)  AS  sun 

A    C  V 

0.53 

0.67 

0.61 

0.  59 

0.77 

-1.61 

0.12 

MAEP-fl 

NARR 

FOLKTALE 

LOG  CONC 

0.56 

0.66 

0.60 

0.64 

0.96 

-0.49 

0.14 

NELS66 

NARR 

FOLKTALE 

LOG  CONC 

0.54 

0.52 

0.56 

0.57 

1.2*9 

0.03 

0.26 

NELS66 

NARR 

FOLKTALE 

EXT  IOEA 

0.31 

0.46 

0.47 

0.43 

0.77 

0.57 

0.22 

HSB 

EXPOS 

LIT 

PURPOSE 

0.  32 

0.53 

0.41 

0.41 

1.10 

0.99 

0.23 

HSB 

EXPOS 

LIT 

UWASSU1 

0.39 

0.49 

0.57 

6.52 

1.64 

0.73 

0.21 

HSft 

EXPOS 

LIT 

LOG  CONC 

0.69 

0.61 

0.60 

0.67 

1.24 

0.24 

0.09 

NE.LS66 

EXPOS 

LIT 

SEQUENCE 

0.32 

0.42 

0.47 

0.43 

1.21 

0.62 

0.24 

HS6 

EXPOS 

SOC  STUD 

IMMSSUN 

0.67 

0.64 

0.61 

0.66 

0.  92 

-0.63 

0.12 

Hsa 

EXPOS 

SOC  STUD 

MAINIDEA 

0.56 

0.61 

0.50 

0.60 

1.61 

0.50 

0.19 

HSB 

EXPOS 

SOC  STUD 

LOG  CONC 

-0.09 

0.03 

0.06 

-0.02 

 HOT 

ESTIMATED  

NELS66 

EXPOS 

SOC  STUD 

TECUM I Q 

0.51 

0.59 

0.56 

0.56 

1 .40 

0.26 

0.24 

NELS66 

EXPOS 

SOC  STUD 

EXT  IOEA 

0.33 

0.40 

0.42 

0.40 

1.75 

1.02 

0.22 

HSB 

EXPOS 

SCIENCE 

MAINIDEA 

0.57 

0.74 

0.66 

0.65 

1 .00 

-0.63 

0.12 

NEL366 

EXPOS 

SCIENCE 

FIG  LANG 

0.59 

0.46 

0.54 

0.55 

1.16 

0.45 

0.19 

HSB 

EXPOS 

SCIENCE 

ATTITUDE 

0.61 

0.67 

0.56 

0.63 

1.12 

-0.19 

0.16 

NCLS64 

EXPOS 

SCIENCE 

SEQUENCE 

0.56 

0.60 

0  71 

0.62 

0.69 

-0.45 

0.20 

3IBR 

POETRY 

MAINIDEA 

0.46 

0.54 

0.46 

0.51 

0.99 

0.04 

0.30 

3XBR 

POETRY 

REL  IOEA 

0.43 

0.45 

0.53 

0.46 

0.41 

0.04 

0.12 

3IBR-R 

POETRY 

LANGUAGE 

0.54 

0.56 

0.59 

0.56 

0.97 

-0.07 

0.21 

3IBR-R 

POETRY 

LOG  CONC 

0.56 

0.64 

0.64 

0.61 

0.95 

-0.72 

0.20 

3IBR-R 

POETRY 

LOG  CONC 

0.65 

0.70 

0.61 

0.71 

1.15 

-0.79 

0.11 

3IBR 

POETRY 

TONE 

0.40 

0.56 

0.60 

0.53 

1.45 

0.62 

9.23 

3IBR 

POETRY 

FIG  LAN6 

0.36 

0.54 

0.56 

0.50 

1.72 

0.47 

0.55 

3IBR 

POETRY 

FIG  LANG 

-0.16 

0.04 

0.15 

-0.01 

 NOT 

ESTIMATED  

NELS66 

POETRY 

LANGUAGE 

0.54 

0.62 

0.76 

0.65 

1.75 

0.17 

0.24 

NELS66 

POETRY 

FIG  LANG 

0  46 

0.45 

0.66 

0.53 

1.19 

0.56 

0.20 

3IBR 

POETRY 

LANGUAGE 

0.56 

0.66 

0.62 

0.70 

1.49 

o.u 

0.13 

3IBR 

NARR 

BTOG 

PURPOSE 

0.59 

0.79 

0.64 

0.71 

1.44 

-0.72 

0.27 

3IBR 

NARR 

BIOG 

LANGUAGE 

0.53 

0.76 

0.63 

0.65 

1.75 

0.21 

0.24 

3IBR 

NARR 

BIOC 

TONE 

0.45 

0.44 

0.46 

0.46 

0.93 

0.23 

0.29 

3IBR 

NARR 

BIOG 

EXT  IDEA 

0.42 

0.37 

0.50 

0.43 

0.49 

-0.97 

0.20 

3IBR 

EXPOS 

SOC  STUD 

ifOASSUN 

0.64 

0.72 

0.66 

0.69 

X. 34 

-0.47 

0.24 

NCL566 

EXPOS 

SOC  STUD 

PURPOSE 

0.56 

0.72 

0.63 

•.69 

1.15 

-0.69 

0.16 

3I8R 

EXPOS 

SOC  STUD 

TONE 

0.45 

0.56 

0.63 

0.54 

1.44 

0.15 

0.94 

NELS64 

EXPOS 

SOC  STUD 

ATTITUDE 

0.65 

0.46 

0.67 

0.66 

1.04 

-0.40 

0.12 

J  ICR 

PERS. 

LETTER 

FT  VIEW 

0.46 

0.60 

0.62 

0.55 

0.79 

-0.99 

0.20 

3IBR 

PERS. 

LETTER 

FIG  LANG 

0.45 

0.55 

0.56 

0.53 

1.04 

0.14 

0.27 

3IBR 

PERS. 

LETTESI 

TECHNIR 

?  i  O 


\ 


PROPORTION  CORRECT 


03 


GRADE: 

a 

10 

12 

TOTAL 

CAIN 

Hi 

700 

470 

429 

1599 

12-0 

ITEM  41 

0 

44 

0.53 

0.62 

0.52 

0.10 

ITEM  A? 

0 

46 

0.59 

0.65 

0.56 

0.17 

0 

45 

0.53 

0.55 

0.50 

0.10 

I  TEH  44 

0 

67 

0.79 

0.00 

0.74 

0.13 

ITEM  45 

0 

59 

0.67 

0.73 

0.65 

0.14 

ITEM  46 

0 

22 

0.27 

0.!0 

0.26 

0.09 

ITEM  47 

0 

42 

0  51 

0  52 

0.47 

0.10 

ITEM  48 

0 

52 

0.59 

0.64 

0.57 

0.12 

ITEM  49 

0 

34 

0.44 

0.53 

0.42 

0.20 

ITEM  50 

0 

47 

0.50 

0.67 

0.56 

0.19 

COL  MEAN 

0 

52 

0.61 

0.66 

0.5O 

0.14 

COL  S.O. 

0 

16 

0.16 

0.15 

0.15 

0.06 

TEST  MEAN 

25 

.79 

30.56 

32.96 

29.12 

7.17 

TEST  S.O. 

9 

.00 

10.32 

10.37 

10.60 

ALPHA 

0 

.90 

0.92 

0.92 

0.92 

TABLE  3-39  (CON'T) 
ITEM  STATISTICS:     READING  TEST 


R-BISERIAL 

a 

10 

12 

TOTAL 

0.52 

0.60 

0.50 

0.50 

0.56 

0.46 

0.63 

0.57 

0.3O 

0.34 

0.31 

0.37 

0  55 

0.66 

0.67 

0.63 

0.51 

0.45 

0.74 

0.56 

0.46 

0.46 

0.40 

0.45 

0.49 

0.35 

0.51 

0.46 

0.53 

0.55 

0.61 

0.56 

0.46 

0.45 

0.51 

0.50 

0.52 

0.67 

0.70 

0.63 

0.4a 

0.55 

0.50 

0.54 

0.16 

0.15 

0.15 

0.14 

PRELIMINARY 
IRT  PARAMETERS 


SOURCE 


TYPE 


COHTEMT 


PURPOSE 


1 

31 

0 

35 

0.21 

3IBR 

PERS. 

LETTER 

LANGUAGE 

0 

79 

-0 

06 

012 

3IBR 

PER*. 

LETTER 

REL  IDEA 

0 

.52 

0 

61 

0.20 

3IBR 

PERIL 

LETTER 

EXT  IOEA 

1 

.51 

-0 

34 

0.36 

3IBR 

PERS. 

LETTER 

REL  IOEA 

0 

.02 

-0 

34 

0.20 

3IBR 

PERS. 

LETTER 

FIG  LANG 

1 

.09 

1 

20 

0.11 

3C8R 

EXPOS 

SCIENCE 

UOASSUM 

0 

05 

0 

56 

0.20 

3C8R 

EXPOS 

SCIENCE 

FIG  LANS 

1 

00 

0 

09 

0.22 

3CBR 

EXPOS 

SCIENCE 

ATTITUDE 

1 

26 

0 

73 

0.20 

3C&R 

EXPOS 

SCIENCE 

ATTITUDE 

1 

73 

0 

22 

0.24 

3CSR 

EXPOS 

SCIENCE 

FIG  LANG 

ABBREVIATIONS?      OCAS  SUM  =  UNDERLYING  ASSUMPTION/MOTIVE 

LOG  CONC  =  LOGICAL  CONCLUSION 

EXT  IDEA  =  EXTENSION  OF  IDEAS 

PURPOSE     =  AUTHOR'S  PURPOSE 


SEQUENCE  =  SEQUENCE /CHRONOLOGY 
MAINIDEA  =  MAIN  IDEA/THEME 
TECHNIQ.  *  AUTHOR ' S  TECHNIQUE 
FIG  LANG  =  FIGURATIVE  LANGUAGE 


ATTITUDE  =  AUTHOR'S  ATTITUDE 

REL  IDEA  *  RELATIONSHIP  BETWEEN  IDEAS 

LANGUAGE  =  USE  OF  LANGUAGE 

PT  VIEM    »  AUTHOR'S  POINT  OF  VTEM 
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TABLE  3-40 


ITEM  STATISTICS:    MATHEMATICS  TEST 


PROPORTION  CORRECT 


GRADE: 

N: 


l 

2 
3 
4 
5 
6 
7 
ft 
9 


ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM  10 
ITEM  11 
ITEM  12 
ITEM  13 
ITEM  14 
ITEM  15 
ITEM  16 
ITEM  17 
ITEM  1ft 
ITEM  19 
ITEM  20 
ITEM  21 
ITEM  22 
ITEM  23 
ITEM  24 
ITEM  25 
ITEM  26 
ITEM  27 
ITEM  2ft 
ITEM  29 
ITEM  30 
ITEM  31 
ITEM  32 
ITEM  33 
ITEM  34 
ITEM  35 
ITEM  36 
ITEM  37 
ITEM  3ft 
ITEM  39 
ITEM  40 


ft 

667 

0.4ft 

0.46 
0.33 
0.34 
0.60 
0.36 
0.41 
0.32 
0.45 
0.49 
0.47 
0.31 
0.34 
0.46 
0.34 
0.41 
0.33 
0.33 
0.22 
0.3ft 
0.22 
047 
0.24 
0.19 
0.03 
0.69 
0.44 
0.63 
0.51 
0.74 
0.30 
0.63 
0.59 
0.40 
0.65 
0.51 
0.44 
0.43 
0.65 
0.4ft 


10 

599 

0.75 
0.72 
0.47 
0.59 
0.03 
0.43 
0.64 
0.56 
0.59 
0.61 
0.61 
0.56 
0.39 
0.65 
0.51 
0.56 
0.4ft 
0.5ft 
0.20 
0.4ft 
0.34 
0.66 
0.30 
0.20 
0.93 
0.76 
0.55 
0.72 
0.67 
0.ft2 
0.60 
0.79 
0.73 
0.57 
0.75 
0.71 
0.50 
0.53 
0.93 
0.64 


12 
546 

0.07 
0.00 
0.54 
0.69 
0.09 
0.54 
0.73 
0.74 
0.71 
0.65 
0.6ft 
0.63 
0.49 
0.73 
0.67 
0.64 
0.5ft 
0.70 
0.32 
0.60 
0.49 
0.77 
0.3ft 
0.22 
0.93 
0.02 
0.62 
O.ftO 
0.73 
0.07 
0.65 
0.66 
O.ftO 
0.67 
0.7ft 
0.00 
0.56 
0.63 
0.93 
0.74 


TOTAL 
1012 

0.69 
0.65 
0.44 
0.53 
0.77 
0.44 
0.5ft 
0.53 
0.57 
0.50 
0.5ft 
0.49 
0.40 
0.61 
0.50 
0.53 
0.46 
0.53 
0.24 
0.4ft 
0.34 
0.62 
0.30 
0.20 
0.09 
0.75 
0.53 
0.71 
0.63 
0.01 
0.51 
0.75 
0.70 
0.54 
0.72 
0.66 
0.50 
0.52 
0.90 
0.61 


GAIK 
12-0 

0.39 
0.34 
0.20 
0.35 
0.20 
0.10 
0.31 
0.42 
0.25 
0.17 
0.21 
0.32 
0.15 
0.26 
0.33 
0.23 
0.25 
0.37 
010 
0.21 
0.27 
0.30 
0.13 
0.03 
0.10 
0.12 
0.1ft 
0.1ft 
0.23 
0.13 
0.35 
0.23 
0.21 
0.27 
0.13 
0.29 
0.12 
0.20 
0.00 
0.2ft 


R-BISERIAL 
10  12 


PRELIMINARY 
IRT  PARAMETERS 


SOURCE      CONTENT  PMCESS 


0.46 
0.52 
0.33 
0.40 
0.50 
0.34 
0.61 
0.53 
0.53 
0.26 
0.50 
0.37 
0.45 
0.50 
0.56 
0.46 
0.61 
0.50 
0.07 
0.43 
0.47 
0.66 
0.20 
0.05 
0.51 
0.25 
45 
43 
49 
36 
46 
56 
56 
0.53 
0.41 
0.6ft 
0.3ft 
0.2* 
0.47 
0.5ft 


0.69 
0.64 
0.50 
0.57 
0.71 
0.4ft 
0.6* 
0.65 
0.57 
0.39 
0.49 
0.41 
0.31 
0.65 
0.62 
0.51 
0.63 
0.53 
0.44 
C.50 
0.53 
0.67 
0.3ft 
0.30 
0.57 
0.20 
0.4ft 
0.45 
0.53 
0.42 
0.62 
0.56 
0.64 
0.56 
0.5* 
0.72 
0.51 
0.34 
0.55 
0.43 


0.67 
0.72 
0.63 
0.64 
0.70 
0.47 
0.75 
0.66 
0.53 
0.40 
0.64 
0.46 
0~9 
0.66 
0.67 
0.63 
0.63 
0.62 
0.32 
9.56 
0.59 
0.71 
0.32 
0.33 
0.63 
0.26 
0.51 
0.34 
0.53 
0.4ft 
0.40 
0.57 
0.62 
0.61 
0.44 
O.ftO 
0.3ft 
0.32 
0.50 
0.56 


TOTAL 


0.66 
0.67 

o.-* 

0.6a 
0.60 
0.46 
0.72 
0.69 
0.50 
0.41 
0.57 
0.50 
0.40 
0.64 
0.67 
0.56 
0.65 
0.63 
0.29 
0.53 
0.59 
0.71 
0.36 
0.20 
0.57 
0.20 
0.50 
0.45 
0.54 
0.44 
0.46 
0.61 
0.42 
0.62 
0.4ft 
0.75 
0.43 
0.47 
0.53 
0.63 


2.07 
1.01 
1.62 
1.3ft 
1.96 
1.03 
1.5ft 
1.33 
1.06 
1.26 
1.00 
1.43 
0.64 
..40 
1.35 
1.71 
1.15 
1.25 
1.3ft 
0.99 
1.05 
\.tt 
1.03 
2.16 
0.91 
0.26 
0.70 
0.56 
0.74 
0.49 
1.35 
1.04 
1.06 
1.00 
0.60 
1.61 
0.67 
0.75 
0.70 
1.00 


-0.11 
-0.00 

0  72 
0.27 
-0.52 
0.79 
-0.00 
0.09 
0.00 
0.62 
0.07 
0.65 
f  .95 
-0.03 
0.?3 
0.47 
0.30 
0.22 
1.60 
0.46 
0.07 
-0.16 
1.46 
1.75 
-2.09 
-2.35 
0.10 
-0.05 
-0.44 
-1.04 
0.25 
-0.00 
-0.53 
0.07 
-6.01 
-0.41 
0.54 
0.79 
-2.42 
-0.10 


0.33 
0.26 
0.25 
0.21 
0.30 
0.23 
0.13 
0.12 
0.20 
0.40 
0.21 
0.20 
0.16 
0.22 
0.13 
0.29 
0.09 
0.10 
0.16 
0.10 
0.17 
0.17 
0.19 
0.15 
0.19 
0.19 
0.14 
0.19 
0.10 
0.19 
0.10 
0.19 
0.19 
0.13 
0.20 
0.11 
0.21 
0.32 
0.19 
0.17 


MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

MSB 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

SIMS 


ARITN 

ALGEBRA 

ALGEBRA 

ARITN 

ALGEBRA 

ARITN 

ALGEBRA 

ARITN 

OATA  REP 

OATA  REP 

ARITN 

ARITN 

ALGEBRA 

ARITN 

ARITN 

GCOM.NES 

ARITN 

GEOM.MES 

GEOMiMES 

ARITN 

GEOM.MES 

ALGEBRA 

ALGEBRA 

GEOmtCS 

Hors 

OATA  INT 

ARITN 

ARITN 

AOVANCEO 

GEOM.MES 

ALGEBRA 

ARITN 

MOTS 

OATA  REP 

OATA  INT 

ALGEBRA 

AOVANlED 

ARITN 

~EOM.MES 

ALGEBRA 


SKL.KNOM 
IN)  COMP 
INI  COMP 
SKLiKNOM 
INI  COhP 

moftsoLV 

UNO  COMP 

SKL.KNOM 

IN)  COMP 

SKL.KNOM 

SKL.KNOM 

UND  COMP 

PROBSOIV 

SKL.KNOM 

PROBSOLV 

SKL.KNOM 

SKL.KNOM 

IN)  COMP 

IN)  COMP 

PROBSOLV 

PROBSOLV 

IN)  COMP 

IN)  COMP 

IN)  COMP 

PROBSOLV 

PROBSOLV 

PROBSOLV 

PROBSOLV 

PROBSOLV 

IN)  COMP 

IN)  COMP 

SKL.KNOM 

PROBSOLV 

SKL.KNOM 

IN)  COMP 

UND  COMP 

PROBSOLV 

IN)  COMP 

SKL.KNOM 

IN)  COMP 
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TABLE  3-40  (CON'T) 
ITEM  STATISTIC^?    MATHEMATICS  TEST 


PRELIMINARY 

PROPORTION  CORRECT  R-BISERIAL  IRT  PARAMETERS  SOURCE      CONTENT  PROCESS 


GRADE: 

ft 

10 

12 

TOTAL 

GAIN 

6 

10 

12 

TOTAL 

A 

B 

C 

N: 

667 

599 

546 

1812 

12-6 

ITEM 

41 

0 

.56 

0 

.69 

0 

.72 

0 

.65 

0 

.16 

0.52 

0.49 

0  .53 

0.  53 

0.  07 

-0.16 

0.27 

NAEP 

OATA  INT 

UO  COMP 

ITEM 

0 

.47 

0 

.61 

0 

.65 

0 

.57 

0 

.1ft 

0.52 

0.52 

0.57 

0.  55 

0.62 

-0.09 

0.14 

NAEP 

APITH 

PROBSOLV 

I  TFM 

43 

0 

.49 

0 

.70 

0 

.03 

0 

.66 

0 

.34 

0.62 

0.66 

0.67 

0.69 

2.56 

-0.25 

0.22 

NAEP 

ARITH 

UND  COMP 

I T  EM 

0 

.29 

0 

.57 

0 

.66 

0 

.49 

0 

.37 

0.60 

0.66 

0.73 

0.  72 

1.  77 

0.25 

0.16 

NAEP 

ALGEBRA 

PROBSCLV 

I T  EM 

45 

e 

.55 

0 

.73 

0 

.83 

0 

.70 

0 

.20 

0.61 

0.60 

0.71 

0.69 

1.19 

-0.66 

0.00 

NAEP 

GEOMiHES 

SKLiKNOU 

I T  EM 

<»6 

0 

.38 

0 

.57 

0 

.64 

0 

.52 

0 

.26 

0.66 

0.75 

0.66 

0.  71 

1.20 

-0.02 

0.06 

NAEP 

GEOM.ME3 

UND  COMP 

T  1  FH 

4  7 

0 

.25 

0 

.73 

0 

.77 

0 

.57 

0 

.52 

0.56 

0.72 

0.79 

0.  76 

i.59 

-0.37 

0.09 

SIMS 

ALGEBRA 

SKLiKMOU 

1 1  FH 

Aa 
H  O 

0 

.46 

0 

.74 

0 

.80 

0 

.65 

0 

.35 

0.50 

0.63 

0.63 

0.65 

1.21 

-0.32 

0.19 

NAEP 

ALGEBRA 

SKLiKNOU 

IT  EM 

it,  O 

0 

.26 

0 

.28 

0 

.44 

0 

.32 

0 

.10 

0.20 

0.41 

0.45 

0.42 

1.67 

1.26 

0.22 

NAEP 

ALGEBRA 

UO  COMP 

ITEM 

50 

0 

.27 

0 

.31 

0 

.40 

c 

.32 

0 

.14 

0.26 

0.53 

0.53 

0.46 

2.25 

1.16 

0.24 

NAEP 

AOVAICEO 

UO  COMP 

ITEM 

51 

0 

.36 

0 

.43 

0 

.52 

0.43 

0 

.16 

0.35 

0.39 

0.52 

0.45 

1.3* 

0.96 

0.29 

NAEP 

GEOHiHES 

UO  COMP 

ITEM 

52 

0 

.10 

0 

.12 

0 

.15 

0 

.12 

0 

.05 

-0.09 

0.31 

0.36 

0.24 

1.  76 

2.13 

0.11 

NAEP 

OATA  REP 

SKLiKNOU 

ITEM 

53 

0 

.52 

0 

.71 

0 

.75 

0.65 

0 

.23 

0.41 

0.61 

0.65 

0.  59 

1.60 

0.11 

0.36 

NAEP 

*  mm  ft,  J  ft\  m\  r 

AOVANCEO 

UO  COMP 

item 

54 

0 

.4ft 

0 

.56 

0 

.61 

0.55 

0 

.13 

0.45 

0.49 

0.59 

0.51 

1.64 

0.57 

0.36 

NAEP 

ARITH 

UO  COMP 

11  EM 

55 

0 

.21 

0 

.24 

0 

.35 

0 

.26 

0 

.15 

0.00 

0.27 

0.47 

0.  34 

1.46 

1.50 

0.20 

NAEP 

ALGEBRA 

UO  COMP 

HEM 

56 

0 

.19 

0 

.45 

0 

.61 

0.40 

0 

.41 

0.50 

0. 74 

0.  77 

0 .  70 

1.62 

0.42 

0.09 

sins 

ALGEBRA 

UO  COMP 

ITEM 

57 

0 

.15 

0 

.32 

0 

.33 

0 

.26 

0 

.10 

0.33 

0.57 

0 .56 

0 . 56 

1 . 14 

1.13 

0.12 

SIMS 

ALGEBRA 

UO  COh? 

ITEM 

56 

0 

.11 

0 

.15 

0 

.25 

0 

.17 

0 

.14 

0.04 

0 .33 

0. 34 

0.  33 

1.C5 

1.99 

0.12 

NAEP 

DATA  REP 

SKL  iKIIUU 

item 

59 

0 

.23 

0 

.23 

0 

.27 

0 

.24 

I 

.04 

0-  00 

0.27 

0.31 

0.  22 

1 . 96 

1.61 

0.20 

NAEP 

ALGEBRA 

POBSuLV 

11  EM 

60 

0 

.40 

0 

.59 

0 

.71 

0 

.55 

0 

31 

0.55 

0.62 

0.61 

0 .64 

1 .44 

0.14 

0.22 

NAEP 

ARITH 

UND  COMP 

ITEM 

61 

0 

.21 

0 

.24 

0 

.34 

0 

.26 

0 

-1  > 

0.09 

0.31 

0. 34 

0 .  30 

1.25 

1.60 

0.19 

^AEP 

AOVANCEt 

UND  COMP 

ITEM 

62 

0 

.31 

0 

.37 

0 

.41 

0 

.36 

0 

10 

0.29 

0  .45 

0  .45 

0.40 

0.  97 

1.20 

0.22 

NAEP 

ALGEBRA 

SKLiKNOU 

1 1  CM 

6  3 

0 

.26 

0 

.33 

0 

.  39 

0 

.32 

0 

13 

0.10 

0.33 

0.55 

0.  37 

2.25 

1.22 

0.24 

NAEP 

GEOMiMES 

PROBSOLV 

ITEM 

64 

0 

.23 

0 

.3ft 

0 

.53 

0 

.37 

0 

31 

0  .56 

0.69 

0 . 70 

0.  70 

1.62 

0.62 

0.13 

NAEP 

6E0M,M£S 

UO  COMP 

ITEM 

65 

0 

.28 

0 

.32 

0 

.52 

0 

37 

0 

24 

0.22 

0.63 

0.71 

0.57 

2.17 

0.06 

0.22 

NAEP 

ARITH 

SKLiKNOU 

ITEM 

66 

0 

25 

0 

.48 

0 

61 

0.44 

0 

36 

0.41 

0.61 

0  ,bl 

0.63 

1.01 

C.36 

0.10 

NAEP 

GEOMiMES 

PROBSOLV 

ITEM 

67 

0 

33 

0 

63 

0 

71 

0 

54 

0 

38 

0.57 

0.66 

0.75 

0.72 

1.62 

0.09 

0.19 

NAEP 

ARITH 

UO  COMP 

ITEM 

68 

0 

50 

0 

66 

0 

74 

0 

63 

0 

24 

0.46 

0.53 

0.72 

0.60 

1.94 

0.22 

0.40 

NAEP 

ARITH 

UO  COMP 

ITEM 

69 

0 

24 

0 

.33 

0 

40 

0. 

32 

0. 

16 

0.10 

0.32 

0.30 

0.35 

1.16 

1.49 

0.24 

lAEP 

OATA  INT 

PROBSOLV 

ITEM 

70 

0. 

24 

0 

25 

0 

32 

0. 

27 

0. 

08 

0.11 

0.13 

0.26 

0.19 

 NOT 

ESTIMATE0  

NAEP 

ALGEBRA 

UND  COMP 

ITEM 

71 

0. 

21 

0 

41 

0 

57 

0 

38 

0 

36 

0.20 

0.59 

0.00 

0.66 

1.63 

0.64 

0.17 

NAEP 

AOVANCEO 

UND  COMP 

ITEM 

72 

0. 

30 

0 

55 

0 

62 

0 

51 

0. 

23 

0.60 

0.65 

0.63 

0.65 

1.17 

0.16 

0.16 

NAEP 

GEOhiMES 

PROBSOLV 

ITEM 

73 

0. 

45 

0 

59 

0. 

64 

0 

56 

0. 

19 

0.52 

0.46 

0.52 

0.53 

1.13 

0.34 

0.31 

NAEP 

AOVANCEO 

PROBSOLV 

ITEM 

74 

0 

22 

0 

40 

0 

50 

0. 

36 

0. 

27 

0.32 

0.55 

0.62 

0.50 

1.24 

0.02 

0.16 

NAEP 

GEOMiMES 

PROBSOLV 

HEM 

75 

0 

25 

0 

54 

0 

66 

0. 

47 

0. 

40 

0.60 

0.72 

0.70 

0.76 

2.25 

0.29 

0.16 

NAEP 

ARITH 

UO  COMP 

1 1  EM 

76 

0 

20 

0 

28 

0 

34 

0. 

27 

0. 

14 

0.15 

0.31 

0.35 

0.33 

 NOT 

ESTIMATED 

1  

NAEP 

ARITH 

PROBSOLV 

1 1  EM 

77 

0 

24 

0 

22 

0. 

29 

0. 

25 

0. 

05 

0.13 

0.25 

0.31 

0.23 

 NOT 

ESTIMATE0 



NAEP 

Algebra 

PROBSOLV 

ITEM 

78 

0. 

0 

45 

0. 

57 

0. 

42 

0. 

29 

0.30 

0.55 

0.59 

0.57 

1.50 

0.60 

0.24 

NAEP 

AOVANCEO 

UO  COMP 

ITEM 

79 

0. 

13 

0. 

13 

0. 

16 

0  . 

14 

0. 

03 

-0.15 

0.20 

0.27 

0  12 

0.91 

2.69 

0.13 

NAEP 

ALGEBRA 

UO  COMP 

HEM 

80 

0. 

32 

0. 

43 

0. 

55 

0. 

43 

0. 

23 

0.14 

0.30 

0.40 

0.36 

0.90 

1.04 

0.31 

NAEP 

AOVANCEO 

SKLiKNOU 
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TABLE  3-40  (CON'T) 


ITEM  STATISTICS:    MATHEMATICS  TEST 


PRELIMINARY 


PROPORTION  CORRECT 

R-BISERIAL 

1RT  PARAMETERS 

SOURCE 

CONTENT 

PROCESS 

GRADE: 

6 

10 

12 

TOTAL 

GAIN 

0 

10 

12 

TOTAL 

a  a 

C 

N: 

667 

599 

544 

1012 

12-6 

ITEM  61 

0.14 

0.26 

0.41 

0.27 

0.25 

0. 

15 

0.49 

0.63 

0.53 

1.47  1.04 

0.17 

NAEP 

ADVANCED 

SKLiKNOM 

ITEM  62 

0.21 

0.22 

0.20 

0.24 

0.07 

-0. 

02 

0.15 

0.39 

0.20 

2.00  1.42 

0.21 

NAEP 

ADVANCED 

(M  COMP 

COL  MEAN 

0.17 

0.51 

0.60 

0.49 

0.22 

0. 

39 

0.51 

0.55 

0.53 

cot  s.o. 

0.16 

0.19 

0.19 

0.17 

0.11 

0. 

19 

0.15 

0.15 

0.16 

Tf ST  MEAN 

30.7$ 

42.12 

49.11 

40. OS 

10.30 

TEST  S.O. 
ALPHA 


12.67 
0.90 


15.71 
0.94 


16.19 
0.95 


16.67 
0.95 


ABBREVIATIONS:      H5B  =    HIGH  SCHOOL  AM)  BEYOND  DATA  REP  * 

NAEP  =  NATIONAL  ASSESSMENT  OF  HOTS  * 

EDUCATIONAL  PROGRESS  DATA  INT  * 

SIMS  s  SECOND  INTERNATIONAL  ADVANCED  = 

MATHEMATICS  STUDY  GEOH.MES  * 


DATA  REPRESENTATION!  PROBABILITY 
HIGHER  ORDER  THIMCING  SKILLS 
DATA  INTERPRETATION*  PROBABILITY 
ADVANCED  TOPICS*  LOGIC 
GEOMETRY  i  MEASUREMENT 


SKI. K HON  -  SKILLS/KNOWLEDGE 

UtC  COMP  =  UNDERSTANDING/COMPREHENSION 

PROBSOLV  *  PROBLEM  SOLVING 


re  I 


9 
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TABLE  3-41 
ITEM  STATISTICS*     SOCIAL  STUDIES  TEST 


PROPORTION  CORRECT 


GRADE* 

N: 


H 


1 

2 
3 
4 
5 
6 
7 

a 

9 


ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM 
ITEM  10A 
ITEM  10B 
ITEM  11 
ITEM  12 
ITEM  13 
ITEM  14A 
ITEM  14B 
ITEM  15 
ITEM  16 
ITEM  17A 
ITEM  17D 
ITEM  16 
ITEM  19 
ITEM  20 
ITEM  21 
ITEM  22 
ITEM  23 
ITEM  24 
ITEM  25 
ITEM  26 
ITEM  27 
ITEM  26 
ITEM  29 
ITEM  30 

mn  31 

ITEM  32 
ITEM  33A 
ITEh  330 
ITEM  33C 
ITEM  330 
HEM  33E 


6 

669 

0.67 
0.65 
0.49 
0.61 
0.54 
0.49 
0.55 
0.69 
0.40 
0.66 
0.76 
0.29 
0.72 
0.51 
0.69 
0.63 
0.53 
O.hI 
0.46 
0.37 
0.47 
0.36 
0.32 
0.42 
0.60 
0.77 
0.52 
0.76 
0.73 
0.45 
0.32 
0.29 
0.74 
0.33 
0.30 
0.62 
0.71 
0.63 
0.51 
0.61 


10 
769 

0.70 
0.60 
0.66 
0.60 
0.66 
0.47 
0.72 
0.65 
0.44 
0.73 
0.61 
0.15 
0.63 
0.54 
0.77 
0.67 
0.72 
0.66 
0.49 
0.36 
0.41 
0.44 
0.30 
0.50 
0.90 
0.79 
0.71 
C.91 
0.65 
0.40 
0.54 
0.29 
0.69 
0.32 
0.43 
0.90 
0.63 
0.92 
0.56 
0.69 


12 
699 

0.65 
0.90 
0.66 
0.64 
0.72 
0.61 
0.79 
0.76 
0.60 
0.74 
0.63 
0.26 
0.90 
0.65 
0.6* 
0.66 
0.66 
0.70 
0.69 
0.64 
0.52 
0.63 
0.41 
0.71 
0.92 
0.90 
0.76 
0.95 
0.90 
0.64 
0.72 
0.50 
0.94 
0.54 
0.63 
0.94 
0.66 
0.94 
0.66 
0.94 


TOTAL 
2137 

0.74 
0.79 
0.61 
0.61 
0.64 
0.59 
0.69 
0.70 
0.46 
0.71 
0.60 
0.23 
0.62 
0.57 
0.76 
0.66 
0.71 
0.59 
0.55 
0.46 
0.47 
0.46 
0.35 
0.54 
0.67 
0.62 
0.67 
0.66 
0.63 
0.49 
0.53 
0.36 
0.66 
0.40 
0.45 
0.69 
0.61 
0.90 
0.57 
0.66 


6  A  IN 
12-8 

0.16 
0.25 
0.17 
0.03 
0.19 
0.32 
0.24 
0.06 
0.19 
0.07 
0.07 
-0.03 
0.16 
0.14 
C.ll 
0.05 
0.34 
0.29 
0.22 
0.27 
0.06 
0.26 
0.09 
0.29 
0.12 
0.13 
0.24 
0.17 
0.17 
0.16 
0.41 
0.20 
0.20 
0.21 
0.33 
0.12 
0.17 
0.11 
0.15 
0.13 


R-BISERIAI 
10  12 


PRELIMINARY 
IRT  PARAMETERS 


SOURCE  CONTENT 


0.56 
0.52 
0.40 
0.40 
0.47 
0.50 
0.46 
0.50 
0.41 
0.33 
0.36 
0.32 
0.59 
0.4? 

o.ie 

0.40 
0.43 
0.31 
0.57 
0.43 
0.57 
0.30 
-0.03 
0.37 
0.57 
0.56 
0.50 
0.63 
0.44 
0.44 
0.22 
0.34 
0.50 
0.25 
0.36 
0.65 
0.47 
0.76 
0.22 
0.65 


0.39 
0.50 
0.51 
0.46 
.21 
.51 
.32 
.$0 
.55 
.31 
.21 
.20 
0.62 
0.34 
0.20 
0.45 
0.61 
0.  4 
0.61 
0.33 
0.40 
0.50 
0.12 
0.27 
0.67 
0.50 
0.50 
0.72 
0.55 
0.31 
0.37 
0.41 
0.57 
0.25 
0.46 
0.70 
0.50 
0.60 
0.26 
0.71 


0.54 
0.6 1 
0.60 
0.52 
0.20 
0.74 
0.50 
0.62 
0.56 
0.25 
0.26 
0.46 
0.73 
0.46 
0.21 
0.39 
0.76 
0.60 
0.64 
0.54 
0.54 
0.51 
0.31 
0.51 
0.64 
0.63 
0.63 
1.00 
0.60 
0.55 
0.50 
0.54 
0.67 
0.47 
0.56 
0.70 
0.65 
0.90 
0.29 
0.65 


TOTAL 


0.52 
0.59 
0.52 
0.44 
0.34 
0.61 
0.50 
0.53 
0.53 
0.30 
0.30 
0.32 
0.67 
0.  2 
O.lJ 
0.40 
0.64 
0.53 
0.60 
0.49 
0.51 
0.50 
0.17 
0.45 
0*66 
0.61 
0.56 
0.76 
0.56 
0.46 
0.47 
0.46 
0.65 
0.39 
0.54 
0.70 
0.56 
O.60 
0.30 
0.73 


0.79 
0.66 
0.99 
1.94 
0.42 
1.64 
0.77 
1.29 
1.53 
0.34 
0.30 
1.32 
1.26 
1.16 
0.23 
0.51 
1.74 
1.02 
1.44 
2.25 
1.05 
1.27 
1.69 
1.50 
1.19 
0.97 
0.74 
1.76 
0.60 
1.22 
0.93 
2.25 
1.04 
2.25 
1.50 
0.66 
0.66 
1.34 
0.32 
1.00 


-6.69 
-0.95 

0.04 

0.49 
-0.26 

0.17 
-0.43 
-0.02 

0.51 
-0.96 
-2.26 

.  152 
-0.96 

0.56 
-2.30 
-0.41 
-0.20 
0.07 
0.25 
0.71 
0.54 
0.56 
1.54 
0.57 
-1.36 
-1.10 
-0.69 
-1.25 
-1.27 
0.63 
0.37 
0.66 
-1.37 
1.04 
0.55 
-1.96 
-1.41 
-1.72 
0.26 
-1.75 


0.24 
0.24 
0.24 
0.42 
0.24 
0.27 
0.24 
0.40 
0.22 
0.24 
0.24 
0.14 
0.24 
0.36 
0.24 
0.24 
034 
0.22 
0.22 
0.26 
0.2^ 
0.22 
0.29 
0.34 
0.24 
0.24 
0.06 
0.24 
0.24 
0.27 
0.23 
0.19 
0.24 
0.26 
0.20 
0.24 
0.24 
0.24 
0.24 
0.24 


NAEP 

NAEP 

NAEP 

NELS06 

NAEP 

NAEP 

NAEP 

NELS66 

NAEP 

NAEP 

NAEP 

NELS66 

NAEP 

NAEP 

NAEP 

NAEP 

NELS66 

NAEP 

NAEP 

NAEP 

NAEP 

NELSOO 

NAEP 

NAEP 

NAEP 

NELSOO 

NAEP 

NAEP 

NAEP 

NELSOO 

NAEP 

HSB 

NAEP 

NELSOO 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 

NAEP 


CIT/GOVT 

AH  HIST 

GEOC 

ETHICS 

AH  HIST 

CIT/GOVT 

GEOG 

ETHICS 

AH  HIST 

CITIZEN 

CITIZEN 

ETHICS 

AM  HIST 

CIT/GOVT 

GEOG 

GEOG 

ETHICS 

AH  HIST 

CIT/GOVT 

CIT/GOVT 

AM  HIST 

ETHICS 

AM  HIST 

CIT/GOVT 

GEOG 

ETHICS 

AH  HIST 

CIT/GOVT 

GEOG 

ETHICS 

AH  HIST 

CIT/GOVT 

AH  HIST 

ETHICS 

AH  HIST 

CIT/GOVT 

CIT/GOVT 

CIT/GOVT 

CIT/GOVT 

CIT/GOVT 


erJc 


225 


n  o  /% 


TABLE  3-41  (CON'T) 


ITEM  STATISTICS:    SOCIAL  STUDIES  TEST 


PRELIMINARY 

PROPORTION  CORRECT  R-BISERIAL  IRT  PARAMETERS  SOURCE  CONTENT 


GRADE  • 

o 

10 

12 

TOTAL 

GAIN 

5 

10 

12 

TOTAL 

A 

5 

C 

669 

769 

9  9  T 

699 

2137 

12-0 

TYFM  IIP 

A  AA 

A  AC 

A  A7 

II  AA 

A  A7 

U  •  II  / 

0.59 

0  44 

A  10 

H<IT 

0  411 

0 .40 

-2 .19 

0 

.24 

4IAFP 

riT/TWH/T 

Wll /OUf 1 

A  A4 
U  .  OH 

A  09 

A  OA 

u  •  th 

A  OA 

II  .  Til 

A   1 A 
V.1V 

A  74 

A  7C 
II .  #D 

A  AO 

A  7Q 

1  90 

-1  AO 

A  •  Oil 

0 

.24 

NACt* 

bll/ OUT 1 

Trcu    i in 

lien  3Jn 

A   4  C 

A  71 

ft  79 
U  .  iC 

A  AA 

A    ft  7 
U.I)/ 

A  AY 

•  .  H* 

A   4  A 

A  IC 

A  10 

II  .  J7 

A  lO 

II  -  3? 

-O  AO 

V  .  OT 

0 

.24 

MaFP 

bl 1 * OUV I 

1 1  tn  v» 

A  1Q 

A    I*  O 

O.It 

A  CI 

A  AT 

ft  19 

U  .  1 1 

A  IC 

II  •  J? 

A   4  7 
V  •  H  / 

A  A9 

II  • 

A  49 

A  77 
II  •  /  # 

A  7A 

0 

.  Zl 

fcj.  cat 

TiL.  1.300 

ITEM  35 

0.35 

0.20 

0.44 

0.35 

0.09 

0.21 

-0.C7 

0.19 

0.15 

2.25 

1.96 

0 

.34 

NAEP 

AM  HIST 

lit M  36 

0  50 

0.70 

0.00 

0.75 

0.31 

0.65 

0.60 

0.01 

0.74 

1.74 

0.56 

0 

.23 

NAEP 

C  IT/ GOVT 

ITEM  37 

0.40 

0 .  40 

A    A  7 
W  .  H  / 

A    1  A 

A  Vk 

A  1A 

A    A  7 
U  -H  / 

A  Al 

II  .HA 

A  AO 

O  .  OV 

A  7A 

0 

.25 

fit  L>0O 

r  tiiirc 
t  InlLj 

HEM  3d 

0.57 

0.71 

0.0* 

0.70 

0.25 

0.53 

0.65 

0.79 

0.60 

1.67 

-0.20 

0 

29 

NAEP 

AM  HIST 

titu  IB 

A    C  A 

V  .  3D 

ft  7C 

f.  AA 

A  79 

A    9  A 

II  .  CO 

A  44 

II .  ^  w 

0  60 

0  7a 

A  Al 
•  •03 

1  10 

-A  49 

0 

20 

NAtr 

AM  HIST 

HEM  40 

0.47 

0.56 

0.01 

0.61 

0.34 

0.50 

0.52 

0.76 

0.63 

1.40 

-0.04 

0 

22 

HS6 

CIT/6QVT 

i i tn  hi 

A    9  A 
II  .  C  II 

A  1C 

o  CI 

II  .  3  A 

A  lA 

If  .  JO 

n  ii 

0.20 

0. 37 

0.51 

0.46 

1 . 06 

0 . 93 

0 

15 

NELSM 

Ethics 

YYFM  49 

1 1 1  n  He 

A  17 

II  .  J  / 

0.53 

A  74 

0.55 

0.  30 

0.3O 

0.  36 

0.46 

0.49 

0. 77 

0.13 

0 

10 

NAEP 

AM  HIST 

YYFH  41 

0 .40 

0 . 56 

0.67 

0.57 

0.19 

0.51 

0. 57 

0.65 

0.60 

1.  97 

0.22 

0 

26 

NAEP 

AM  HIST 

IHM  44 

0.50 

0.71 

0.77 

0.69 

0.19 

0.50 

0.52 

0.56 

0.55 

0.74 

-0.67 

0 

15 

NELSM 

ETHICS 

HEM  45 

0.19 

0.20 

0.25 

0.21 

0.06 

0.02 

0.00 

0.32 

0.17 

1.00 

1.95 

0. 

19 

NAEP 

AM  HIST 

HEM  46 

39 

0.47 

0.53 

0.46 

0.14 

0.24 

0.19 

0.25 

0.26 

0.31 

0.90 

0. 

15 

NAEP 

AM  HIST 

HEM  47 

0.44 

0.52 

0.65 

0.54 

0.21 

0.44 

0.55 

0.61 

0.57 

1.10 

0.20 

0. 

19 

NAEP 

AM  HIST 

HEM  40 

0.36 

0.44 

0.55 

0.45 

0.19 

0.10 

0.41 

0.56 

0.43 

1.75 

0.04 

0. 

30 

NAEP 

AM  HIST 

HEM  49 

0.33 

0.42 

0.56 

0.44 

0.23 

0.03 

0.12 

0.29 

0.23 

0.27 

1.30 

0. 

15 

NACP 

AM  HIST 

IHM  50 

0.36 

0.44 

0.60 

0.47 

0.24 

0.25 

0.41 

0.64 

0.40 

1.01 

0.73 

0. 

30 

NAEP 

AM  HIST 

COL  MEAN 

0.53 

0.61 

0.71 

0.62 

0.10 

0.42 

0.44 

A. 56 

0.50 

COL  S.O. 

0.17 

0.20 

0.17 

0.10 

0.09 

0.17 

0.10 

0.19 

0.15 

TEST  MEAN 

31.69 

36.35 

42.71 

36.97 

11.02 

TEST  S.O. 

10.00 

9.50 

10.30 

10.04 

ALPHA 

0.60 

0.60 

0.91 

0.91 

ABBREVIATIONS:      MSB  =    HIGH  SCHOOL  AND  BEYOND  CIT/GOVT  =  CITIZENSHIP/GOVERNMENT 

NAEP  -  NATIONAL  ASSESSMENT  OF  AM  HIST    *  AMERICAN  HISTORY 

EDUCATIONAL  PROGRESS  GEOG  =  GEOGRAPHY 

NELS60  =  NEM  ITEMS  FOR  HE L SOB  CITIZEN    =  CITIZENSHIP 


no7 


TABLE  3-42 


ITEM  STATISTICS^    SCIENCE  TEST 


•^4 
PC 


PROPORTION  CORRECT 


R-BISERIAL 


PRELIMINARY 
IRT  PARAMETERS 


SOURCE 


CONTEHT 


GRADE: 

m 

a 

1  A 

10 

lc 

IUI  AL 

GAIN 

A 

o 

1  A 

1  9 
1£ 

TT1T  k  1 
IUI  AL 

4 
A 

A 

D 

N: 

A.  a  f 

▲  11 

473 

A  9A 

™;£.4 

1  C  OA 

19  VH 

12-6 

ITEM 

I 

0.  35 

A  1A 

A  .9 

o  .nz 

A  1A 

0 .  36 

0 

.07 

A    9  9 

A  9C 

9  .  £9 

A    1 A 

0  •  30 

A  9A 

V  •  CO 

A 

O  •  t  3 

1.45 

0.27 

ur  i  AAA 

NtLSOO 

1  tec  «r*T 
Lire  aL<l 

ITEM 

2 

0 .00 

0.64 

0.66 

A  AT 

0.63 

0 

.06 

A  11 

0 . 31 

0.49 

A  IT 

0.3/ 

A  TO 

O  .  3t 

0.54 

-2.09 

0.13 

U  CA 

c  AH  In 

ITEM 

3 

0. 39 

0 . 50 

0 . 56 

0.47 

0 

.19 

0.  32 

0 .40 

A  CA 

u .  54 

A  AC 

0  .45 

A  AA 

0 . 66 

0.51 

0.20 

NAtP 

PHT5  SCI 

ITEM 

4 

0.  36 

0. 53 

0 .56 

0 .46 

0 

.16 

0.42 

0 .46 

A  CI 

0.9/ 

A  CI 

0.51 

1 .  zz 

0.43 

0.16 

NAtP 

PHYS  SCI 

PHYSICS 

ITEM 

5 

0.43 

0  .61 

0.64 

0.54 

0 

.21 

0. 35 

0. 35 

0.  23 

A  11 

0 . 36 

0.55 

0.24 

0.20 

NAEP 

Lire  SCI 

ITEM 

6 

0. 55 

0.67 

1  0.66 

0.61 

0 

.12 

0 . 35 

0.44 

0.43 

0.42 

0. 73 

-0.15 

0.20 

NAEP 

EARTH 

ITEM 

7 

0.17 

0 . 15 

0. 16 

0. 16 

-0 

.01 

-0. 06 

0.07 

0  .20 

0. 04 

2 . 12 

2.26 

0.16 

NAEP 

PHYS  SCI 

men 

cm  en 

ITEM 

a 

0.67 

0.66 

0. 70 

0.66 

0 

.03 

0.20 

0.20 

0 . 26 

0 .22 

A    9  7 

0 .  Z  / 

-1.14 

0.20 

NAEP 

I  ire   or* T 
Lift  SCI 

ITEM 

9 

0.56 

0.65 

0.67 

0.61 

0.10 

0.31 

0. 37 

A     1  "» 

0.  3' 

0 . 35 

0 .51 

-0.2o 

0.20 

NAEP 

BUM*    »y * 

PnTS  SCI 

PHYSICS 

ITEM 

10 

0.57 

0.  71 

0.  75 

0.66 

0 

.16 

0.36 

0.36 

0.  3o 

0.42 

0.66 

-0.47 

0.20 

NAEP 

EARTH 

TECHISOC 

ITEM 

11 

0.43 

0.50 

0.55 

0.46 

0 

.13 

0. 33 

0 .46 

0.49 

A  AA 

0  .44 

A  Bt 

0.  92 

0.46 

0.20 

NAEP 

1 tFE  err 
Lire  SCI 

Aitittr 
wUANI 

ITEM 

12 

0 .64 

0.  71 

0. 73 

0.69 

0.09 

A  lA 

0.  30 

A    A  9 

0.4c 

A  CI 

0 .53 

A    A 1 

0.41 

a  a  a 
0 .69 

-0.60 

0.20 

UicB 

NAtP 

buvi  err 
PUT 5  SCI 

mm 

Critn 

ITEM 

13 

0.33 

0. 36 

0.  33 

A  1A 

0.  34 

-0 

00 

0.23 

0  *  35 

a  9  a 

A    9  7 
0  .  Z  / 

i  ii 
1 . 31 

1.43 

0.26 

NAEP 

EARTH 

ITEM 

14 

0.62 

0 .69 

0.  75 

0.66 

0 

.12 

0.1/ 

A  57 
0  .  Z  / 

A  XI 
0  •  31 

A  17 

O.  Z  / 

A  11 

O.  31 

-1.27 

0.13 

■  TCC    AT  W 

Lire  SCI 

ITEM 

15 

0 .  Zl 

A  IE 

0.19 

A  17 
0.1/ 

A    1 A 

u .  io 

-0 

04 

_A    1  C 

~  v.  19 

_  ft  11 
-0.13 

A   ft  a 
O  •  OO 

_  ft  11 
-0.11 

 UflT 

ESTIMATED  

U1CD 

NAEP 

Ptl  ■  9  XI 

PHYSICS 

ITEM 

16 

ft    it  9 

A  KA 

A  C/t 

ft  AO 

0 

12 

a  \y 

U  •  3/ 

ft    A  9 
U  0£ 

A  AO 

A  CA 
V  •  9U 

1  IE 

1 .  35 

0.41 

0.21 

NAtP 

t  AH  111 

ITEM 

17 

ft   A 1 
U  .  *f  1 

A  A.1 

0  .  ol 

A    A.  T 

0  .  o  3 

A  CI 

U  .  93 

0 

22 

A  Aft 

U  .  3D 

O   A  7 

A  C9 

O  .  9£ 

l  ii 
1  •  33 

0.29 

0.22 

NAtf 

Llrt  SCI 

crni  ficv 

ITEM 

10 

ft   A  9 

A  CI 

0  •  >o 

A    A.  1 

0.61 

ft  CI 
0.51 

0. 

19 

A  TA 

W  .  30 

A  CA 
U  •  9U 

A  A& 

A  &7 

1  91 
1  •  £1 

0.42 

0.24 

lira 

PnTS  SCI 

rTl  TMw 

ITEM 

19 

a  it  f 

A  EC 

D  .  55 

a  ao 

a  cn 

0.90 

0. 

02 

V  •  £"t 

A  17 
0.1/ 

A    1  O 

O  •  1  T 

A  91 

O  .  £1 

A  11 

0  •  33 

0.65 

0.20 

NAtP 

t  an  in 

ITEM 

20 

ft  IaA 
U  .MO 

A  CI 

0 . 53 

9  •  O  1 

A  El 
0.93 

0 

14 

A  9ft 

II  •  £  V 

A  W 
W  •  33 

A  AC 

A  XT 

O  *  33 

1  17 
1  •  3/ 

0.61 

0.36 

UiEB 

NAtP 

PnTS  SCI 

m  1  wr  rm 
PHYSICS 

XTEM 

21 

n  16 
U  •  J"# 

0  AA, 

u .  *to 

0.51 

0.42 

0. 

17 

0  .  15 

0.42 

0.24 

0.  31 

0  AO 

1.14 

0.26 

NAEP 

iter  err 
Lire  Ad 

C  LU  LUU I 

ITEM 

22 

0.48 

0.66 

0.75 

0.62 

0. 

27 

0.46 

0.64 

0.66 

0.61 

1.75 

-0.19 

0.15 

HS6 

PHYS  SCI 

CHEN 

ITEM 

23 

0.45 

0.51 

0.62 

0.51 

0. 

17 

0.35 

0.41 

0.42 

0.41 

0.56 

0.06 

0.09 

NAEP 

LIFE  SCI 

ECOLOGY 

ITEM 

24 

0.16 

0.19 

0.23 

0.19 

0. 

07 

0.16 

0.26 

0.32 

0.27 

0.59 

2.26 

0.06 

NAEP 

EARTH 

ITEM 

25 

0.41 

0.52 

0.50 

0.46 

0. 

09 

0.13 

0.33 

0.34 

0.26 

1.43 

1.21 

0.37 

NAEP 

PHYS  SCI 

CHEN 

ITEM 

26 

0.22 

0.32 

0.37 

0.29 

0. 

15 

0.14 

0.34 

0.45 

0.35 

1.34 

1.33 

0.19 

NAEP 

PHYS  SCI 

PHYSICS 

ITEM 

27 

0.45 

0.59 

0.54 

0.51 

0. 

09 

0.29 

0.50 

0.44 

0.42 

0.63 

0.39 

0.22 

NAEP 

LIFE  SCI 

ECOLOGY 

ITEM 

26 

0.41 

0.56 

0.56 

0.50 

p. 

16 

0.37 

0.59 

0.46 

0.50 

1.05 

0.29 

0.17 

NAEP 

EARTH 

ITEM 

29 

0.59 

0.69 

0.76 

0.67 

0. 

19 

0.35 

0.39 

0.35 

0.40 

0.66 

-0.51 

0.20 

NAE  ? 

LIFE  SCI 

ITEM 

30 

0.26 

0.32 

0.36 

0.3X 

0. 

06 

0.35 

0.41 

0.30 

0.36 

0.69 

1.S9 

0.16 

NAEP 

EARTH 

ITEM 

31 

C.36 

0.40 

0.37 

0.36 

-0. 

01 

0.16 

0.06 

0.26 

0.15 

0.37 

1.32 

0.04 

NAEP 

PHYS  SCI 

PHYSICS 

ITEM 

32 

0.39 

0.44 

0.46 

0  43 

0. 

09 

0.22 

0.25 

0.26 

0.26 

C.56 

1.40 

0.26 

NAEP 

LIFE  SCI 

EvoLirr 

ITEM 

33 

0.39 

0.47 

0.52 

0.45 

0. 

14 

0.30 

0.37 

0.42 

0.36 

0.95 

0.79 

0.25 

NAEP 

EARTH 

ITEM 

34 

0.12 

0.06 

0.11 

0.10 

-0. 

01 

-0.11 

-0.10 

0.12 

-0.05 

 NOT 

ESTIMATED  

NELS66 

PHYS  SCI 

PHYSICS 

ITEM 

35 

0.25 

0.29 

0.25 

0.26 

0. 

00 

Q.2S 

0.13 

0.34 

0.23 

1.69 

1.74 

0.23 

NELS66 

EARTH 

GRAPH 


TFCH4SOC 


GRAPH 


TECHASOC 


CO 
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TABLE  3-42  (CON'T) 


ITEM  STATISTICS:    SCIENCE  TESY 


PRELIMINARY 

PROPORTION  CORRECT  R-BI SERIAL  IRT  PARAMETERS  SCUKTE  CONTENT 


GRADE: 

a 

10 

12 

TOTAL 

CAIN 

0 

10 

12 

TOTAL 

A 

0 

C 

N: 

697 

473 

424 

1594 

12-0 

ITEM  34 

0.16 

0.29 

0.31 

0.25 

0.12 

0.31 

0.40 

0.31 

0.30 

0.66 

1.S1 

0.07 

H56-R 

LIFE  SCI 

ITEM  17 

0.20 

4.20 

0.34 

0.27 

0.16 

-0.00 

0.07 

0.19 

0.11 

 NOT 

ESTIMATED  

NAEP 

PUTS  SCI 

CNEH 

ITEM  3d 

0.15 

0.23 

0.21 

0.19 

0.06 

0.03 

0.23 

0.10 

0.10 

0.07 

2.46 

0.17 

NELS6G 

LIFE  SCI 

ITEM  39 

0.60 

0.71 

0.74 

0.71 

0.06 

0.17 

0.14 

0.34 

0.22 

0.24 

-1.70 

0.20 

NAEP 

PNYS  SCI 

CNEH 

ITEM  40 

0.19 

0.25 

0.26 

0.23 

0.07 

0.06 

0.32 

0.20 

0,22 

1.47 

1.91 

0.22 

NAEP 

LIFE  SCI 

ITEM  41 

0.26 

0.30 

0.44 

0.34 

0.19 

0.36 

0.50 

0.47 

0.40 

0.73 

0.72 

0.04 

HS8 

EAR  7ft 

SCI  moc 

ITEM  42 

0.34 

0.45 

0.49 

0.41 

0.15 

0.10 

0.30 

0.44 

0.30 

1.15 

1.17 

0.31 

NAEP 

PNYS  SCI 

CHEN 

COL  MEAN 

0.40 

0.40 

0.50 

0.45 

0.11 

0.23 

0.33 

0.36 

0.32 

COL  S.O. 

0.16 

0.10 

0.19 

0.17 

0.07 

0.15 

0.17 

0.13 

0.15 

^4 


TEST  WEAN 
TEST  S.O. 
ALPHA 


16.62 
5.27 
0.69 


20.05 
6.47 
0.00 


21.20 
6.62 
0.01 


10.06 

6.35 
0.79 


4.57 


ABBREVIATIONS:      HS8        =  HIGH  SCHOOL  AM)  BE  YOU)  PHYS  SCI 

HS6-R    =  HIGH  SCHOOL  AND  BE  YOU)  EARTH 

IREVISEO  ITEM)  LIFE  SCI 

NAEP      =  NATIONAL  ASSESSMENT  OF  CHEM 

EDUCATIONAL  PROGRESS  TEOUSOC 
NELSOO  =  KEN  ITEM  FOR  NFLS  00 


PHYSICAL  SCIENCE 
EARTH  SCIENCE 
LIFE  SCIENCE 
CHEMISTRY 

SCIENCE  $  TECHNOLOGY » 
AND  SOCIETY 


QUANT        =  QUANTITATIVE 
GRAPH        =  GRAPHICAL  INTERPRETATION 
SCI  PROC  «  SCIENTIFIC  PROCESSES 
EVOLUT      =  EVOLUTION 


r  o 
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3.3.6.1     Reading  Test 


The  statistics  on  the  reading  item  pool  at  shown  in  Table  3-39  provide 
additional  evidence  for  the  unidimensionality  of  the  reading  items.  That 
is,  the  reliability  of  the  reading  item  pool  is  quite  high  at  each  grade 

"  "•a,ured  by  coefficient  Alpha  (bottom  left  hand  columns  of  Table 
3-39).    Reliabilities  of  .90  to  .92  are  considered  relatively  high  for  a 
fifty  item  tost  and  consistent  with  an  assumption  of  unidimension/ility. 
The  mean  item  difficulty  of  .52  at  the  eighth  grade  suggests  that  the 
reading  item  pool  a*  it  now  stands  should  have  little  or  no  problem  with 
floor  effects.    The  difference  between  the  test  s-ore  means  when  going 
from  8th  to  10th  grade  #.s  relatively  impressive.    There  is  approximately 
a  5  raw  score  point  gain,  or  in  terms  of  standard  deviation  units,  a  gain 
of  approximately  half  a  standard  deviation.    The  gain  is  not  so 
impressii    from  grades  10  to  12.    This  might  simply  reflect  an  expected 
levelling  off  of  the  reading  growth  curve  during  the  transition  from  the 
10th  to  12th  grade  and  not  necessarily  the  presence  of  ceiling  effects. 
Given  these  results,  it  would  seem  reasonable  to  have  identical  forms  for 
the  8th  and  xOth  grade  and  then  change  tne  12th  grade  form  somewhat  to 
incorporate  those  items  that  showed  the  greater  changes  when  going  from 
the  10th  to  the  12th  grade.    The  trick  here  is  to  reduce  the  Reading  test 
from  50  items  down  to  20  *o  satisfy  time  constraints  with  a  minimum  loss 
in  either  the  reliabilities  or  the  differences  between  the  grade  level 
means. 

The  following  items  were  selected  for  the  8th  and  10th  grade  20  item 
reading  form. 

Items  6-9;  expository  literature  passage. 
Items  10-12;  expository  social  studies  passage. 
Items  16-18;  expository  &  :iei  ce  passage. 
Items  20-24,  26,  28;  poetry. 
Items  35-37;  expository  social  studies. 

As  indicated  below  we  propose  to  make  the  Reading  test  mildly  grade 
level  adaptive,  i.e.,  the  12th  grade  form  will  be  slightly  different  from 
the  above  eighth/r  >  x\i  grade  form.    This  would  seem  desirable  since  the  same 
items  that  showed  large  eighth  to  tenth  grade  gains  were  not  necessarily  the 
same  items  showing  large  tenth  to  twelfth  grade  gains. 

The  proposed  twelfth  grade  form  included  the  following  20  items. 

Items  6-9;  expository  literature  passage. 
Items  10-12;  expository  social  studies  passage. 
Items  16-18;  expository  science  passage* 
Ite-s  39-42,45;  personal  letter/ 
Items  46-50;  expository  science. 

Table  3-43  presents  the  summary  statistics  for  the  proposed  20 
item  Reading  test  which  would  be  administered  at  grades  8  and  10  and  the 
slightly  modified  form  for  grade  12.    The  coefficient  Alpha  estimates  of 
internal  consistency  reliability  of  .82,  .85,  and  .84  for  grades  8,  10, 
end  12  are  excellent  for  a  20  item  test.    It  should  be  noted  that  the 
difference  in  means  between  the  8th  and  10th  grade  twenty  item  test  form 
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TABLE  3-43 


SCORE  STATISTICS  BY  GRADE,  SEX  AM)  RACE 
READING  TEST 


MADE  ft 

NUMER  Of  CASES 
Ail  ITEMS: 

HE AN*  EFFECT  SIZE 
S.3>. 
ALMA 
SELECTED  ITEM  SUBSET 
HE AN*  EFFECT  SIZE 
S.D. 
ALPHA 

CRADE  10 


NUMBER  OF  CASES 
AL1  ITEMS: 

ME  AN  i  EFFECT  SIZE 
S.O. 
ALPHA 

SELECTEO  ITEM  SUBSET  :•« 
MEAN*  EFFECT  SIZE 
S.D. 
ALPHA 

GRADE  12 


NUMBER  OF  CASES 
ALL  ITEMS: 

ME AN i  EFFECT  SIZE 
S.D. 
ALMA 

SELECTED  ITEM  SUBSET:** 
MEAN,  EFFECT  SIZE 
S.D. 
ALMA 


EFFECT  SIZE* 


MEAN  CHANGE  I  POOLED  S.D. 
GRADE  0  TO  GRADE  10 


TOTAL 

MALE 

FEMALE 

BUCK 

MUTE 

HISPANIC 

ASIAN 

MALE* 
FEMALE 

fcOUTE- 
BLACK 

UNITE - 
HISPANIC 

UNITE- 
ASIAN 

700 

321 

310 

92 

375 

126 

04 

25.0 
0.9 
0.90 

24.1 
10 .0 
0.90 

27.5 
0.90 

20.5 
0.6 
0.07 

27.0 
9.5 
0.90 

23.4 
9.5 
0.09 

26.7 
10.1 
0.91 

-0.3 

0.7 

0.4 

0.1 

10.2 
4.6 
0.02 

9.4 
4.0 
0.01 

10.9 
4.6 
0.02 

7.0 
4.1 
0.77 

1 A  Q 

4.5 
0.01 

9.  3 
4.2 
0.70 

10.7 

4.0  . 
0.04 

-0.3 

0.7 

0.4 

0.0 

470 

250 

212 

30 

316 

71 

23 

30.4 
10.3 
0.92 

29.3 
10.9 
0.93 

52.0 
0.91 

23.6 
0.07 

31.6 
10.4 
0.92 

30.2 
9.1 
0.09 

31.2 
10.5 
0.93 

-0.3 

O.B 

i 

0.1 

5.S 

12.5 
4.0 
0.05 

12.1 
5.1 
0.07 

13.0 
4.4 
0.02 

9.4 
4.3 
0.79 

11  A 

4.0 
0.06 

19  1 

4.3 
0.01 

13.0 
<,.4 
0.03 

-0.2 

0.7 

0.2 

-0.0 

429 

100 

236 

63 

266 

62 

23 

11  A 

10.4 
0  •  93 

31.0 
11.7 

A  Oil 
V  •  TP* 

34.0 
9.1 
0.91 

30.9 
10.7 
0.93 

33.9 
10.4 
0.93 

33.9 
0.6 
0.90 

27.5 
10.1 
0.91 

-0.2 

0.3 

-0.0 

0.4 

12.4 
4.7 
0.04 

12.1 
5.1 
0.07 

14.  ft 
4.3 
0.01 

11.3 
4.9 
0.05 

12.0 
4.7 
0.05 

12.6 
4.0 
0.79 

1 A  7 
Aft  •  # 

4.0 
0.05 

— v  .* 

0.3 

0.0 

0.4 

UNITS 1 

0.49 

0.56 

b.46 

0.39 

0.44 

0.66 

0.40 

•  EFFECT  SIZE  =  ISUBWOUPI  MEAN  -  SUBGROUP2  HE  AN)  /  TOTAL  GRADE  STAHDARO  DEVIATION 
52!  1  7    6    9  10  II  If  16  17  ie  39  W  «  *E  V.  "  *7  it  *9  M 
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in  terns  of  the  new  standard  deviation  units  continues  to  be  about  one- 
half  a  standard  deviation.    It  would  appear  that  the  much  shortened  form 
has  as  much  sensitivity  to  growth  as  did  the  full  SO  item  pool. 

It  is  not  appropriate  to  contrast  the  raw  score  means  of  the  10th 
and  12th  grade  at  this  time  because  of  the  different  items  involved.  The 
12th  grade  form  was,  of  course,  made  slightly  more  difficult  to  minimize 
ceiling  effects.    Accurate  comparisons  of  differences  between  means  for 
these  two  grades  require  the  re-estimation  of  the  IRT  parameters  using 
only  the  selected  items  that  make  up  the  reduced  pool  used  in  the  new 
forms.    Based  on  the  present  reliabilities  and  the  selection  of  items 
having  the  most  growth  potential,  we  would  expect  the  re-estimated  scaled 
scores  (thetas)  to  approximate  or  exceed  the  mean  differences  found  in 
the  total  item  pool. 

Contrasts  between  the  various  ethnic  groups  and  whites  as  shown  by 
the  effect  size  columns  remain  quite  constant  whether  the  full  50  items 
or  the  20  item  test  is  used.    While  the  reliability  for  the  Blacks  is 
somewhat  lower  than  that  of  the  whites  at  both  grade  8  and  grade  10,  tht 
standard  errors  of  measurement  are  virtually  the  same.    There  does 
appear,  however,  to  be  a  slight  floor  effect  fot  Blacks  at  the  8th  and  to 
a  lesser  extent  the  10th  grade.    It  is  our  opinion  that  this  effect  is 
not  of  sufficient  size  to  be  of  any  great  concern.    It  should  be  kept  in 
mind  that  wb«*n  measuring  change  the  effect  of  greatest  concern  is  the 
minimising  t*.  potential  ceiling  effects. 

The  selected  items  for  the  final  forms  also  included  7  items  from 
the  HS&B  Reading  test  which  should  be  sufficient  to  put  the  NELS  items  on 
the  same  scale  £s  HS&B  if  one  wishes  to  compare  performance  between  the 
1980  HS&B  sophomore  cohort  and  the  comparable  1990  NELS  sophomores. 

Appendix  B  presents  the  correlations  between  student  self-reports  of 
the  number  of  relevant  courses  taken  and  performance  on  the  total  reading 
item  pool.    Tenth  and  12th  graders  were  asked  how  many  years  of 
coursework  they  had  taken  in  each  subject  since  10th  grade.    The  8th 
grade  questionnaire  asked  only  whether  or  not  each  course  had  been  taken 
during  the  current  year.    In  the  eighth  grade  almost  all  the  students 
report  taking  the  courses  in  question.    While  we  feel  that  this 
information  is  of  some  utility,  it  is  the  correlates  of  change  that  are 
of  primary  importance.    At  the  higher  grade  levels,  it  is  not  so  much  the 
number  of  courses  taken,  but  whether  they  were  "advanced"  courses  or  not 
(see,  e.g.,  Rock  et  al.). 

3.3.6.2     Mathematics  Test 

As  in  the  case  of  the  Reading  test,  the  coefficient  Alpha 
reliability  estimates  (see  Table  3-40  bottom  1  .ft  hand  columns)  based  on  the 
total  82  item  mathematics  pool  suggests  the  presence  of  a  single  dominant 
factor.    The  fact  that  there  is  almost  a  full  standard  deviation  gain 
when  going  from  grade  8  to  grade  10  is  very  encouraging.    P  newhat  less 
encouraging  is  the  smaller  but  still  substantial  gain  between  grades  10 
and  12.    These  results  suggest  that  o.?e  form  should  be  sufficient  for  the 
8th  and  10th  grade  while  a  somewhat  different  form  will  be  used  in  grade 
12.    As  in  the  case  of  the  Reading  test  the  items  that  show  growth 
between  grades  8  and  10  are  not  necessarily  the  same  items  that  show 
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growth  between  10  and  12.    Criteria  for  selecting  items  for  the  final 
font  are  qui*e  similar  to  that  for  ttie  Reading  test.    Items  are  selected 
that  are  characterised  by  relatively  high  biserials  and  that  also  show 
large  growth  rates  between  grades  8  and  10  and/or  10  and  12.    In  addition 
we  want  to  provide  coverage  of  the  various  mathematics  content  areas.  An 
additional  constraint  is  that  we  also  wish  to  include  sufficient  HS&B 
iteas  in  the  final  pool  to  be  able  to  "crosswalk"  between  the  HS&B 
cohorts  and  the  comparable  NELS  cohorts. 

The  mathematics  items  selected  for  the  40  item  8th  and  10th  grade 
forms  are  shown  below. 

Items  1,4,8,12,14,15,17,28,32,38,42,43,54,60,68;  Arithmetic. 
Iteas  2,5,7,22,31,36,40,44,47,48;  Algebra. 
Items  9,10,34,35,41;  Data  representation  or  interpretation. 
Iteas  16,18,45,46,51;  Geometry. 

Iteas  25,29,33,53,^3;  Higher  order  thinking  skills /problem 

solving. 

The  following  list  of  40  items  ar*  proposed  for  the  12th  grade 
Mathematics  form. 

Items  1,4,6,8,15,17,20,38,43,60,65,75;  Arithmetic. 

Iteas  7,13,22,23,40,44,49,55,56;  Algebra. 

Items  9,34,58,1)9*  Data  representation. 

Items  16,18,19,5^.51,64,66,72,74;  Geometry. 

Items  50, 61, 71, 7b, 80,81;  Advanced  problem  solving. 

Mot  surprisingly  v*e  have  included  slight? v  more  geometry  and  "higher 
order  t>    king"  <r  advanced  problem  solving  items  in  tne  12th  grade  form 
than  r         8/l0th  grad*  form.    The  inclusion  of  *  criterion  that 
emphat  ne  selection  of  items  showing  large  changes  when  going  from 

grade  *         grade  12,  as  was  the  cats  in  constructing  the  12th  grade 
form,  censed  to  select  items  that  followed  the  normal  curriculum 
sequence.    Twenty-one  items  from  the  HS6B  tests  are  also  present  in  the 
selected  NELS  item  pool.    This  should  be  more  than  sufficient  to 
"crosswalk"  from  NELS  to  the  comparable  HS&B  cohorts  if  desired. 

The  group  statistics  and  reliabilities  of  the  8/lOth  grade  form  and 
the  12th  grade  form  are  presented  in  Table  3-44.    Inspection  of  the 
reliabilities  across  the  three  grades  suggests  that  the  proposed  40  item 
Mathematics  test  forms  lost  little  or  no  reliability  when  the  item  pool 
w«  cut  in  half.    The  grade  8/ 10  forty  item  form  maintained  the  full 
reliability  of  the  total  82  item  pool  at  the  eighth  grade  and  only 
dropped  from  .94  to  92  at  the  tenth  grade.    The  "mildly  adaptive"  forty 
item  grade  12  form  also  demonstrated  excellent  reliability  (  .91).    As  in 
the  Reading  test  the  reliabilities  for  Blacks  arc  lower  than  those  for 
the  Whites  in  all  three  grades.    However,  when  the  standard  errors  of 
measurement  are  compared  there  is  virtually  no  difference  at  any  of  the 
grade  leveU ,    There  simply  appears  to  be  less  heterogeneity  among  the 
Black  examinees  than  among  the  Whites.    There  does  not  appear  to  be  much 
if  any  floor  effect  involved  here. 

Tne  classifying  of  clusters  of  items  that  reflect  different  levels 
of  difficulty  as  well  as  content  is  also  underway.    That  is,  if  one  can 
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TABLE  3-44 

SCORE  STATISTICS  0Y  MADE,  SEX  AND  RACE 
MATHEMATICS  TEST 

EFFECT  SIZE* 


fULE-       MUTE-       MUTE-  MUTC- 
TOTAL     HALE      FEMALE     SLACK    WHITE    HISPANIC    ASIAN  FEMALE       SLACK       HISPANIC  ASIAN 


SHADE  ft 


NMMEIt  OF  CASES 

447 

311 

272 

125 

303 

1*7 

04 

kiX  ITEMS: 

HAN.  EFFECT  SIZE 

S.D. 

ALPHA 

30.7 
12.7 
0.90 

31.4 
13.2 
0.91 

29.5 
12.0 
0.09 

24.4 
0.9 
0.00 

33.9 
13.4 
0.91 

;o.2 

11.0 
0.07 

33.9 
13.5 
0.92 

0.2 

0.7 

0.5 

-0.0 

SELECTED  XTtn  aWJatl'"" 
MEAN,  EFFECT  SIZE 
S.D. 
ALMA 

10.3 
0.7 
0.90 

10.7 

0.  ▼ 

0.90 

17.4 
0.09 

13.7 
0.00 

20.4 
0 . 9 
0.91 

16.0 
7.9 
0.07 

21.0 
0.9 
0.90 

0.1 

0.0 

0.4 

-0.1 

MADE  10 

NUMBER  OF  CASES 

599 

225 

360 

00 

346 

AO 

34 

ALL  ITEMS: 

MEAN,  EFFECT  SIZE 

S.3. 

ALPHA 

42.1 
15.7 
0.94 

45.2 
14.5 
0.95 

40.5 
14.9 
0.93 

20.4 
12.2 
0.90 

46.7 
14.3 
0.93 

37.5 
14.0 
0.92 

51.2 
10.1 
0.96 

0.3 

1.2 

0.4 

-0.S 

SELECTED  ITEM  SWIScT-** 
MEAN.  EFFECT  SIZE 
S.O. 
ALPHA 

25.0 
0.92 

27.2 

g  1 

0.92 

25.2 
9.1 
0.92 

17.2 
7.4 
0.06 

20.7 
0.1 
0.91 

23.1 
0.7 
0.90 

29.9 
0.0 
0.93 

0.2 

1.3 

0.4 

-0.1 

GRADE  12 

MMER  OF  CASES 

546 

210 

336 

49 

351 

73 

36 

ALL  ITEMS: 

MEAN*  EFFECT  SIZE 

S.O. 

ALPHA 

49.1 
16.2 
0.95 

52.6 

16.  a 

0.95 

46.9 
15.9 
0.95 

32.9 
12.7 
0.90 

53.4 
14.6 
0.94 

41.5 
15.0 
0.93 

54.2 
14.9 
0.95 

0.* 

1.3 

0.7 

-0.0 

SELECTED  ITEM  SUBSET:** 
MEAN.  EFFECT  SIZ, 
S.O. 
ALPHA 

23.0 
9  0 

0.91 

24.7 

a. 9 

0.92 

21.9 
0.9 
0.91 

14.5 

>.o 

0.03 

25.2 
0.4 
0.91 

10.9 
0.1 
0.00 

25.9 
7.0 
0.90 

0.3 

1.2 

0.7 

-0.1 

MEAN  CHANGE  < POOLED  S.O. 

UNITS  1 

GRADE  S  TO  GRAOE  10 

0.04 

0.?5 

0.07 

0.52 

0.90 

0.77 

1.00 

•  EFFECT  SIZE  *  JSUBGROUPl  MEAN  -  SUBGR0UP2  MEAN)  /  TOTAL  GRAOE  STAND  ABO  DEVIATION 

M  PROVISIONAL  SUBSET  OF  ITEMS  SELECTEO  FOR  TEST  FORM' 

*AOES  6AMD  ID:    1    M    (    7    6    tllUUlS  14  17  M  El  ES  20  EG  SI  SE  33  34  35  34  »  *•  «  **  *5  «* 

45  44  47  46  51  53  5*  46  66  73  ,  .  mjl       .„       ,  . 

GRADE  12:    I    4    4    7    H    »  13  IS  16  17  1*  1G  EG  El  22  23  34  30  4G  43  44  44  M  51  55  54  56  60  61  64 
©  65  66  6G  71  72  74  75  76  06  61  9  Q  7 
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find  clusters  of  items  that  form  a  hierarchically  ordered  scale,  the 
resulting  scale  scores  can  have  a  limited  diagnostic  as  well  as  a 
normative  interpretation  since  they  can  be  tied  to  mastery  of  various 
levels  of  mathematical  proficiency^    At  the  present  time  a  cluster  of 
items  representing  simple  arithmetic  operations  have  been  identified* 
these  items  reflect  the  application  of  simple  rules.    Tvo  second  level 
parcels  or  clusters  have  also  been  tentatively  identified.    One  cluster 
is  defined  by  the  application  of  simple  algebraic  rules  while  the  other 
second  level  parcel  applies  simple  geometry  rules  in  the  solutions. 
Hopefully  a  third  level  cluster  of  items  requiring  more  complex  algebraic 
reasoning  can  be  identified.    Since  different  students  will  be  in 
different  places  with  respect  to  their  mathematical  development,  their 
change  scores  can  be  estimated  with  respect  to  each  of  these  levels. 

Appendix  P  presents  the  correlations  between  student  self-reports  of 
mathematics  courses  taken  and  performance  on  the  total  mathematics  item 
pool.    The  same  cautions  concerning  interpretations  apply  here  as  they 
did  with  respect  to  reading. 

3.3.6.3     Social  Studies  Test 

As  indicated  above  the  Social  Studies  test  item  pool  came  close  to 
meeting  our  criterion  of  unidimensionality.    Inspection  of % the 
preliminary  IRT  results  as  well  as  the  reliabilities  in  Table  3-41  along 
with  supplementary  information  from  the  item  trace  functions  suggest  that 
it  may  not  provide  such  a  bad  fit  to  an  assumed  unidimensional  model. 
The  fact  that  the  factor  analytic  rotations  tended  to  mix  seemingly 
disparate  content  areas  across  all  factors  also  suggested  that  this 
domain  may  be  more  unidimensional  than  originally  thought.    Given  this 
background,  items  were  selected  emphasising  their  sensitivity  to  growth 
along  with  an  "eye"  towards  the  biserials  (and  the  A  parameters)  as  well 
as  the  content  areas.    While  the  Social  Studies  test  may  be  close  to 
unidimensionality,  there  does  not  seem  to  be  any  comp2lling  psychometric 
reason  for  scaling  it  using  IRT  and  making  it  grade  level  adaptive.  The 
test  seems  to  be  easy  enough  for  the  8th  graders  given  that  the  average 
item  difficulty  for  the  8th  graders  is  .53.    There  might  be  a  slight 
ceiling  effect  as  indicated  by  an  average  difficulty  of  .71.    It  would  be 
better  if  the  average  difficulty  for  the  12th  graders  was  in  the  .60  to 
.65  range.    This  "slight"  ceiling  effect  is  sufficiently  trivial  that  it 
probably  can  be  reduced  by  a  judicious  selection  of  items  for  the  final 
form. 

The  items  selected  for  the  proposed  30  item  final  form  are  listed 
below: 

Items  1,13, 17a, 17b, 21, 29, 36,40;  Citizenship/government. 
Items  2,9,12,16,24,28,30,32,38,39,42,43,47,48,50;  American 

History. 

Items  15,19,31,37,41,44;  Ethics. 
Item    7;  Geography 

While  there  are  probably  enough  items  in  Citizenship/government  and 
American  History  to  form  subscales,  there  is  litcle  evidence  from  the 
factor  rotations  that  these  subscales  have  discriminant  validity. 
Unfortunately  there  are  not  a  lot  of  Geography  or  Ethics  items  in  the 
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pool  and  in  the  case  of  Geography,  those  that  are  present  tend  to  be 
relatively  easy.    Adding  those  to  the  final  form  could  lead  to  ceiling 
effects* 


Table  3-45  presents  the  reliabilities  and  group  statistics  for  the 
proposed  single  final  form  for  the  three  grade  levels.  The 
reliabilities  of  the  30  item  form  are  good  for  a  test  of  this  length. 
The  shortened  test  forn  showed  slightly  larger  differences  between  means 
across  grade  level  in  terms  of  standard  deviation  units  than  did  the 
total  item  pool.    This  was  particularly  true  in  the  transition  between 
the  10th  and  12th  grade.    Thus  the  reduced  form  has  somewhat  less  of  a 
ceiling  effect  than  does  the  full  item  pool.    The  shortened  form  seems 
relatively  sensitive  to  growth  in  that  there  is  about  57Z  of  a  standard 
deviation  gain  between  grades  8  and  10  and  70Z  of  a  standard  deviation 
gain  between  grades  10  and  12.    It  would  seem  that  the  single  30  item 
form  could  satisfactorily  measure  gains  in  Social  Studies  performance 
across  all  three  grades. 

3.3.6.4     Science  Test 

The  Science  Test  is  a  bit  of  a  puzzle.    As  indicated  above  the 
latent  root  ratio  criterion  for  unidimensionality  was  not  met.  The 
subsequent  factor 'analysis  of  product  moment  (phi  coefficients)  did  not 
yield  an  easily  interpretable  set  of  factors  (see  Appendix  D).    While  the 
Science  test  may  be  multidimensional,  it  was  hoped  that  it  would  yield  a 
factor  structure  more  consonant  with  the  original  test  specifications. 
That  is,  the  test  specifications  required  items  at  all  levels  of 
difficulty  within  the  areas  of  Earth  Science,  Life  Science,  Chemistry, 
and  Physics.    The  factor  analysis  results  may  be  more  complex  than 
expected  because  items  of  similar  difficulty  levels  may  be  trying  to  load 
on  the  same  factors  even  though  their  item  content  area  is  different,  As 
indicated  above,  factor  analysis  of  item  intercorrelations  based  on  phi 
coefficients  tend  to  yield  difficulty  factors  independent  of  content 
areas. 

It  was  decided  to  estimate  the  TRT  parameters  even  though  the  test 
appears  to  be  multidimensional.    This  provides  us  with  further  evidence 
for  or  against  the  unidimensionality  atf umption.    It  also  should  be  kept 
in  mind  that  while  the  test  is  not  unidimensional  in  the  strict  sense  it 
still  possesses  a  single  dominant  factor.    The  IRT  results  only  rejected 
three  items  on  the  basis  that  item  performance  was  not  a  monotonically 
increasing  function  of  ability  (theta).    However,  the  biaerials,  A 
parameters,  and  the  reliabilities  tended  to  be  lower  on  the  Science  test 
than  on  the  other  three  tests. 

These  results  tend  to  be  consistent  with  what  the  NAEP  researchers 
found  with  thei    Science  pool.    It  was  decided  here  to  select  a  target 
test  based  on  "sensitivity  to  growth",  that  is,  items  showing  between 
grade  gain,  which  also  had  reasonable  reliabilities  and  that  follow  the 
original  test  specifications  as  closely  as  possible.    The  resulting 
target  test  could  then  be  evaluated  in  terms  of  possible  subscales 
scoring  if  sufficient  items  fell  on  each  scale. 

The  following  items  were  tentatively  selected  for  the  "final"  25 
item  form: 
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TABLE  3-45 

SCORE  STATISTICS  BY  GRADE.  SEX  AM)  RACE 
50CIAL  STUDIES  TEST 


EFFECT  SIZE* 


MALE- 

MHITE- 

WITE- 

HHITE- 

TOTAL 
----- 

HALE 
____ 

FEMALE 

------ — 

BLACK 

— — 

WHITE 
————— 

HISPANIC 
________ 

ASIAN 
_____ 

FEMALE 

BLACK 

----- 

HISPANIC 

—————— 

ASIAN 

— — — — • 

GRADE  • 

MMER  OF  CASES 

311 

273 

123 

304 

127 

05 

ALL  ITEMS: 

MEAN,  EFFECT  SIZE 

91.7 

31.4 

31.7 

26.4 

33.4 

31.5 

33.9 

-0.0 

0.7 

.2 

-0*0 

SO. 

10.0 

10.3 

9.7 

0.7 

10.0 

9.6 

9.4 

ALPHA 

0.09 

0.09 

0.00 

0.04 

0.09 

0.07 

0.00 

SELECTEO  ITEM  SUBSET: mm 

MEAN.  EFFECT  SIZE 

13.9 

13.9 

13.0 

11.4 

14.0 

13.7 

15.0 

0.0 

0.6 

o.z 

-0.0 

S.D. 

5.7 

5.0 

5.6 

4.6 

5.9 

5.5 

5.5 

ALPHA 

0.B1 

0.02 

0.00 

0.72 

0.03 

0.00 

0.00 

MADE  10 

NUMBER  OF  CASES 

769 

209 

470 

110 

427 

140 

40 

ALL  ITEMS: 

MEAN.  EFFECT  SIZE 

34.4 

37.3 

35.0 

27.7 

30.6 

34.0 

30.3 

0.2 

1.1 

0.3 

0.0 

S.D. 

9.5 

10.7 

o.s 

7.7 

9.2 

e.o 

9.4 

ALPHA 

0.09 

0.92 

tV.Ot 

0.00 

0.09 

0.04 

0.09 

SELECTEO  ITEM  SUBSET1** 

MEAN.  EFFECT  SIZE 

17.2 

17.6 

17.0 

12.2 

10.5 

16.9 

10.6 

0.1 

1.1 

0.3 

-0.0 

S.D. 

5.0 

6.7 

5.2 

4.6 

5.9 

4.0 

5.9 

ALPHA 

0.04 

COO 

0.79 

0.71 

0.05 

0.75 

0.05 

GRADE  12 

NUMBER  OF  CASES 

699 

255 

442 

01 

430 

123 

42 

ALL  ITEMS: 

MEAN.  EFFECT  SIZE 

42.7 

43.7 

42.2 

30.9 

44.9 

42.4 

44.1 

0.1 

1.4 

0.2 

0.1 

S.D. 

10.2 

10.9 

9.0 

10.7 

0.0 

9.2 

9.2 

ALPHA 

0.92 

0.93 

0.91 

0.91 

0.90 

0.09 

0.90 

SfUCTEO  ITEM  SUBSET:** 

MEAN.  EFFECT  SIZE 

21.4 

22.0 

21.1 

14.5 

22.0 

21.0 

22.3 

0.1 

1.3 

0.3 

0.1 

S.D. 

6.2 

6.7 

5.9 

4.0 

5.5 

5.6 

5.7 

ALPHA 

0.09 

0.91 

0.07 

0.04 

0.07 

0.05 

0.50 

MEAN  CHANCE  1  POOLED  S.O. 

UNITS) 

GRADE  6  TO  GRADE  10 

0.57 

0.59 

0.59 

0.17 

0.62 

0.63 

0.64 

GRADE  10  TO  GRADE  12 

0.70 

0.65 

0.74 

0.44 

0.76 

0.70 

0.64 

•  EFFECT  SIZE  =  ISUBGR0UP1  MEAN  -  SUBGR0UP2  MEAN)  /  TOTAL  GRADE  STAND ARO  DEVIATION 

mm  PROVISIONAL  SUBSET  OF  ITEMS  SELECTEO  FOR  TEST  FORM: 

ALL  GRADES:  1    2    7    9    12  13  15  16  17A  17B  19  21  24  20  29  30  31  32  34  37  SO  19  40  41  42  4  3  44  47  40  5 
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Items  4,9,18,20,26;  Physical  Science/Physics. 
Item*  5,11,14,17,21,23,29,36;  Life  Science. 
It»M0, 16,24,28,30,33,41;  Earth  Science. 
Item* 3,12,22,42;  Physical  Science/Chemistry. 

While  none  of  the  content  groupings  have  sufficient  numbers  of  items 
to  support  an  IRT  approach  to  developing  subscales,  one  could  use  the 
simple  ,,rat#H  scale  sores  in  evaluating  change  for  at  least  3  of  the  4 
subscales. 

Table  3-46  presents  the  reliabilities  of  this  25  item  test  and  the 
mean  contrasts  with  sex  and  ethnic  groups.    Inspection  of  Table  3-46 
suggests  that  the  25  item  test  was  equally  as  reliable  as  the  original  42 
item  test.     The  reliabilities,  while  being  lower  than  the  ether  three 
tests,  are  consistent  with  the  notion  of  a  multidimensional  test.    A*  in  the 
case  of  the  Reading  test,  there  appears  to  be  a  difference  in  reliabilities 
between  Blacks  and  whites  at  the  8th  and  the  12th  grade.    Once  again  when 
the  standard  errors  of  measurement  are  computed  and  compared,  there  is 
little  difference.    Contrasts  of  the  means  across  grades  for  the  total 
sample  suggest  that  there  is  over  one-half  a  standard  deviation  gain  between 
8th  and  10th  grade  and  about  a  fifth  of  a  standard  deviation  gain  when  going 
from  the  10th  to  the  12th  grade.    The  gain  between  the  8th  and  10th  grade  is 
about  equivalent  to  that  found  using  the  total  science  item  pool.    The  gain 
between  10th  and  12th  grade,  however,  in  terms  of  standard  deviation  units, 
is  slightly  greater  for  the  shorter  test. 

It  is  our  opinion  that  further  factor  analytic  work  using 
tetrachoric  correlations  corrected  for  guessing  should  be  carried  out 
using  the  TBSTPACT  program  (Bock,  Gibbons,  &  Muraki;  1985)  before  the 
final  Science  test  is  constructed.    Such  analysis  might  cast  additional 
light  on  the  further  development  of  subscales. 
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TABLE  3-46 

SCORE  STATISTICS  BY  GRADE ,  SEX  AM)  RACE 
SCIENCE  TEST 


EFFECT  SIZM 


• 

MALE- 

MUTE- 

MUTE- 

MUTE-* 

total 

MALE 

rCrULt 

BLACK 

Nnl  1 1 

11  A9r"AflAl> 

ACT  AM 

IT  fh  a  1  F 

S' LACK 

HISPANIC 

ASIAN 

GRADE  6 

NUMBER  Or  CASES 

oyf 

3A  T 

171 

3/3 

ACQ 

66 

ALL  ITEMS: 

0.2 

0.6 

MEAN,  EFFECT  SIZE 

16.4 

17.1 

16.? 

13.9 

17.7 

16.6 

17.6 

0.7 

O.i 

S.O. 

5.3 

5.7 

6.6 

6.1 

5.2 

6.7 

5.6 

ALtHA 

0.69 

0.76 

0.66 

0.50 

0.66 

0.62 

0.71 

cci  rrtcn    f tcm   CtCKCT  'mm 

5ELECTED   Altn  3l»3ti 

0.6 

-0.0 

MEAN,  EFFECT  SIZE 

10.6 

1  A  A 

10  .0 

in  i 
10 . 1 

A  1 

A  A  .  £ 

A  O 

11.3 

0  9 

0.6 

S.O. 

6 . 1 

6.6 

3.  V 

3.  3 

L.  1 
H  .  A 

J  .  © 

6 . 3 

ALPHA 

0 .  70 

0 . 76 

0.66 

0 . 55 

•I  Am 

0.66 

A  CO 

O  .St 

.  /  3 

GRAOE  10 

NUrCER  OF  CASES 

673 

253 

212 

la 
3V 

3AO 

79 

9L 

CI 

ALL  ITEMS: 

MEAN,  EFFECT  SIZE 

20.1 

21.3 

16.4 

16., 

21.2 

16.6 

21.3 

0.6 

0.7 

0.7 

-0.0 

S.O. 

6.5 

6.7 

5.9 

6.5 

6.5 

6.6 

6.7 

ALPHA 

0.60 

0.62 

0.76 

0.61 

0.60 

0.60 

0.63 

m?**9  m    WF  m9*  *  W9  mm.       W  tf  f  mmt      f"  A  9m*%      C  *  •  am  am 

SELECTEO  ITEM  SUBSET  •** 

MEAN,  EFFECT  SIZE 

13.  2 

16  - 1 

i  *  a 
1Z .  0 

10.1 

A'l  .  A 

in  a. 
AO  •  0 

A  J  .  O 

n  l, 

a  7 

0 . 7 

0.1 

S.O. 

5.0 

5 . 1 

t+  A. 
H  .© 

.  V 

3.0 

• 

ALRIA 

0 . 60 

0 . 62 

a  ta 
0 .  76 

n  AC 

A  AA 

0  •  DO 

A    A.  A 
O  •  OO 

n 

GRADE  12 

NUMBER  OF  CASES 

626 

167 

C  33 

Ol 

O  A 

23 

ALL  ITEMS: 

0.5 

MEAN,  EFFECT  SIZE 

21.2 

22.7 

20.1 

16.9 

22.7 

19.6 

19.7 

0.6 

0.9 

0.6 

S.O. 

6.6 

7.2 

5.6 

5.1 

6.5 

5.1 

7.9 

ALRIA 

0.61 

0.65 

0.76 

0.67 

0.61 

0.66 

0.66 

SELECTEO  ITEM  SUBSET 

0.5 

MEAN,  EFFECT  SIZE 

16.2 

15.6 

13.6 

11.1 

15.5 

13.0 

13.0 

0.6 

0.9 

0.5 

S.O. 

6.6 

5.0 

6.5 

6.1 

6  .6 

6.2 

5.7 

ALPHA 

0.7? 

0.62 

0.75 

0.66 

0.76 

0.72 

0.66 

MEAN  CM  AUG  E  1  POO  LEO  S.O, 

UMITSI 

GRAOE  S  TO  GRAOE  10 

0.61 

0.70 

0.6S 

0.57 

0.63 

0.67 

0.53 

GRADE  10  TO  GRADE  12 

0.22 

0.25 

0.32 

0.16 

0.30 

0.60 

-0.16 

•  E5FECT  SIZE  =  I  SUB  GROUP  1  MEAN  -  SUDGROUP2  MEAN  I  /  TOTAL  GRADE  STAJOAR0  0EVIATI0N 
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The  Educational  Testing  Service  (ETS)  was  contracted  by  OERI  to 
develop  the  MBLS  test  battery  in  order  to  assets  students'  cognitive 
growth  during  their  transition  from  grade  eight  to  grade  twelve.  The 
students  are  to  be  tested  in  the  spring  of  88  (eighth  grade),  then 
retestnd  in  the  spring  of  90  (tenth  grade)  and  then  retested  again  in  the 
spring  of  (92)  as  Seniors.    The  long  term  goal  of  the  NELS  longitudinal 
study  is  to  estimate  the  extent  and  correlates  of  cognitive  growth  in 
four  cognitive  areas.    The  four  cognitive  areas  are: 

•  Reading  or  Literacy 

•  Mathematics 

•  Science 

•  Social  Studies 

Two  pretest  forms  were  constructed— Form  A  and  Form  B.    Form  A 
included  50  pretest  items  for  the  Reading  test  and  42  pretest  items  for 
the  Science  test.    Form  B  included  82  pretest  items  for  the  Mathematics 
test  and  60  items  for  the  Social  Studies  test.    The  two  forms  were 
spiralled  within  each  grade  level.    A  total  of  1599  students  across  all 
grades  took  Pons  A  while  1812  students  took  Form  B.    When  the  full  scale, 
administration  occurs  in  88,  only  one  and  one  quarter  to  one  and  one  half 
hours  will  be  available  for  testing.    Given  these  limitations,  four 
relatively  short  tests  had  to  be  constructed  from  the  pretest  item  pool. 

The  four  preliminary  shortened  forms  include  20  reading  items,  40 
mathematics  items,  30  social  studies  items,  and  25  science  items.  The 
Reading  and  Mathematics  tests  were  constructed  to  be  "mildly  adaptive" 
according  to  grade  level.    That  is,  students  in  the  8th  grade  receive  the 
same  form  when  they  are  retested  in  the  tenth  grade,  but  they  then 
receive  a  slightly  different  form  in  the  12th  grade.    The  change  in  the 
12th  grade  forms  was  proposed  in  order  to  minimize  che  impact  of  ceiling 
effects  on  gains.    The  use  of  adaptive  tests  assumes  IRT  scaling.  Both 
the  proposed  Reading  and  Mathematics  test    met  the  assumotions  necessary 
for  IRT  scrlii^. 

The  Social  Studies  and  Science  test  were  less  homogeneous  in 
content,  and  in  tie  case  of  the  Science  test,  apparently  not  appropriate 
for  IRT  scaling.    The  Social  Studies  test  appeared  to  have  neither 
ceiling  nor  floor  effects  and  it  is  suggested  that  one  form  be  used  at 
all  grade  levels.    While  it  is  suggested  that  one  form  of  the  apparently 
multidimensional  Science  test  be  used  at  all  grade  levels,  further 
analysis  should  be  carried  out  before  the  decision  is  made  concerning  the 
final  form. 

In  spite  of  being  relatively  short,  the  preliminary  forms  of  the 
Reading,  Mathematics,  and  Social  Studies  tests  exhibited  quite  good 
reliabilities.    It  is  of  interest  to  compare  the  reliabilities  of  the 
proposed  forms  with  tne  comparable  measures  from  the  HS&B  battery.  Table 
3-47  presents  the  reliabilities  for  the  Sophomore  and  Senior  cohorts  from 
HS*B  and  the  comparable  cohorts  from  the  NELS  pretest  sample. 
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TABLE  3-47 


RELIABILITIES  FOR  HS&B  AND  NELS  TESTS 

Test  HS&B  NELS 

Sophomore  Senior  Sophomore  Senior 


Reading 

.77 

.80 

.85 

.84 

Hath 

.87 

.90 

.92 

.91 

Science 

.74 

.76 

.80 

.79 

The  only  exactly  comparable  reliability  comparison  in  the  above 
table  it  the  Reading  test  since  both  the  HS*B  and  the  proposed  NELS  test 
have  exactly  20  items.    There  is  considerable  improvement  here.  The 
increase  at  the  Senior  level  is  probably  mostly  due  to  the  adaptive 
approach  that  uses  a  slightly  different  form  at  the  12th  grade.  The 
reliability  for  the  NELS  8th  graders  is  also  higher  than  either  the  HS&B 
Sophomore  or  Senior  cohort  reliability  (.82).         These  improvements  are 
particularly  encouraging  since  the  primary  consideration  in  item 
selection  was  an  item's  sensitivity  to  growth  across  grades. 

The  Mathematics  test  form  in  HS&B  had  38  items  compared  to  the  40 
items  in  the  proposed  NELS  forms.    We  have  some  improvement  in  the  NELS 
form  at  the  Sophomore  level  but  no  gain  at  the  Senior  level  when  you  take 
in  consideration  the  two  extra  items.    The  NELS  8th  grade  cohort  yielded 
a  reliability  of  .90  which  was  also  quite  respectable.    Both  the  proposed 
NELS  Reading  and  Mathematics  torms  maintained  quite  high  reliabilities 
throughout  the  three  grade  range  while  selecting  items  with  maximum 
potential  for  measuring  change. 

If  you  correct  the  HS&B  Science  test  for  the  fact  that  it  had  only 
20  items  vs.  25  for  the  NELS  Science  test,  it  still  falls  slightly  short 
of  the  NELS  test  (.78  vs  .80)  for  the  Sophomore  cohort.    At  the  Senior 
level  they  are  about  the  same. 

The  two  HS&B  and  NELS  Social  Studies  were  so  different  with  respect 
to  numbers  of  items  (10  vs  30)  that  any  comparisons  would  be  suspect. 
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CHAPTER  4:  PART  A 

DATA  COLLECTION  OP  THE  MELS:8S  PARENT  SURVEY 


4.0     Overview  of  the  Data  Collection 

What  follow!  it  an  account  of  the  data  collection  of  the  NELS:88 
Parent  Survey.    The  chapter  is  divided  into  nine  sections.    The  first 
section  addresses  the  sampling  design  of  the  survey.    The  second 
section  describes  the  contents  of  the  parent  packet,  thac  is,  the 
Parent  Questionnaire  and  accompanying  materials.    Three  different 
methods  were  employed  to  send  the  parent  packets  to  the  parents.  The 
chapter's  third  section  explains  why  three  methods  were  used,  describes 
assignment  of  schools  to  methods,  summarizes  procedures  used  for  each 
method,  relates  the  outcome  of  using  each  procedure,  and  presents 
recommendations  on  choice  of  method  for  the  base  year.     The  fourth 
section  of  the  chapter  describes  the  receipt  control  systems— both 
manual  and  electronic—that  were  employed  on  the  Parent  Study.  The 
editing  and  coding  functions  are  the  subject  of  the  fifth  section. 
Included  are  a  description  of  the  retrieval  that  was  performed  on  th- 
critical  items  of  the  Parent  Questionnaire  (including  a  summary  of  the 
items  that  were  most  often  retrieved)  and  a  description  of  how  the  data 
were  computer-entered.    Section  Six  considers  the  four  stages  of  the 
Parent  Study  Pollow-Up;  the  thank  you/reminder  postcard,  the  prompting 
telephone  call,  the  telephone  interview  and  the  personal  interview. 
Again,  the  experience  obtained  with  these  four  stages  is  described  and 
suggestions  are  provided  for  improvements  in  the  base  year.  Section 
Seven  provides  specific  completion  rates,  school  by  school,  for  parents 
of  all  sampled  students  (excluding  ineligibles),  parents  of  students 
who  actually  participated  in  the  Student  Survey,  and  parents  of 
students  whose  school's  cases  were  subject  to  the  full  range  of  parent 
survey  follow-up  procedures.    It  also  examines  parent  participation 
rates  under  the  following  groupings:  Ethnicity  (OB EM LA  status);  School 
Sector  (Catholic,  Other  Private  or  Public);  and  Permission  Type 
Required  (Implied,  Explicit).    Section  Eight  addresses  the  special  case 
of  the  New  York  City  Public  Schools.    The  restrictions  placed  on  the 
NELS:88  Parent  Survey  by  the  New  York  City  Board  of  Education  are 
summarized,  the  procedures  that  were  followed  a     explained,  parent 
participation  response  rates  and  special  problem*  encountered  are 
noted,  and  recommendations  for  the  base  year  are  listed.    The  ninth 
section  is  the  conclusion  to  the  chapter    Its  purpose  is  to 
consolidate  lessons  learned  during  this  field-test  year  to  improve  the 
Parent  Survey  of  the  base  yoar. 


4.1      Sampling  Design  of  the  Parent  Survey 
4.1.1      Determination  of  Sample  Size 

While  the  number  of  eighth-grade  schools  selected  for  the  student 
sample  was  governed  by  the  number  of  cognitive  test  observations 
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required  for  analysis,  a  smaller  number  of  observations  were  needed  for 
analysis  of  the  Parent  Questionnaire.    Thus  only  34  of  the  52  eighth- 
»  grade  schools  were  selected  to  have  the  Parent  Survey.  One 

/  parent /guardian  of  each  of  the  selected  eighth-grade  students  in  the  34 

schools  was  made  a  respondent  in  the  study. 

\  4.1.2     Distribution  of  the  Parent  Survey  Across  School  Sectors 

To  assure  adequate  representation  of  private  schools,  all  sampled 
private  eighth-grade  schools  were  designated  to  have  the  parent  study. 
Schools  located  in  areas  with  heavy  student  survey  activity  comprised 
the  balance  of  the  parent  sample  institutions.    This  was  tone  to  assure 
efficiency  both  in  terms  of  cost  and  personnel. 

4.2     The  Parent  Packet 

The  parent  packet  consisted  of  a  copy  of  the  Parent  Questionnaire, 
a  letter  introducing  the  study  to  the  parent  (see  Appendix),  and  an 
envelope  with  pre-paid  postage  for  return  of  the  questionnaire  to  NORC. 
The  letter  emphasized  the  confidential  nature  of  the  survey,  requested 
the  parent  to  promptly  se«d  the  completed  questionnaire  to  NORC,  and 
asked  the  respondent  to  call  "Chris  Rodgers"  collect  at  HORC  if  there 
were  any  questions  either  about  the  study  or  the  questionnaire.    In  all 
cases,  the  packet  envelope  was  addressed:    TO  THE  PARENTS  G?:  (Name  of 
Student).    This  mode  of  address  was  used  because  a  particular  parent 
respondent  was  not  designated;    it  was  desired  that  the  parents  of  the 
child  themselves  decide  which  parent  was  the  more  knowledgeable 
concerning  the  child's  education. 


4.3     Three  Methods  of  Questionnaire  Delivery 

4.3.1  Purpose  of  the  Delivery  Experiment 

In  order  to  determine  the  optimal  method  of  delivering  parent 
questionnaires  in  the  base  year  and  to  study  the  comparative  advantages 
and  disadvantages  of  each  of  the  different  delivery  modes,  three  means 
of  sending  parent  questionnaires  were  used:    Student  Delivery,  Central 
Office  Mail,  and  School  Mail. 

4.3.2  Distribution  of  Methods  Over  Schools  in  the  Sample 

For  the  purpose  of  assigning  delivery  methods  to  the  schools  in 
which  a  parent  survey  was  to  be  held,  only  two  delivery  categories  were 
considered:  Student  Take  Home  and  Mail  Delivery.    Central  Office  Mail 
and  School  Mail  were  collapsed  into  one  category  to  reflect  the 
assumption  that  a  parent  receiving  the  questionnaire  would  not  be  able 
to  distinguish  the  source  of  the  identical ly-packaged  mailing.  By 
random  selection,  approximately  half  of  the  34  schools  were  assigned  to 
each  treatment.    (Note:    In  some  of  the  subsequent  analysis,  however, 
we  considered  it  of  interest  to  examine  the  overall  impact  on  parent 
response  rates  of  using  the  two  distinct  types  of  mail  delivery  since 
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such  iactors  at  quality  of  addresses  available  and  the  respective 
efficiency  of  NORC  and  school  personnel  in  mailing  could  influence 
response.    In  looking  at  such  comparisons,  the  reader  is  cautioned 
that,  as  vill  be  explained  shortly,  assignment  of  schools  to  the  School 
Mail  treatment  was  essentially  by  t  If -selection,  not  random 
selection. ) 


4.3.3  Student  delivery 

4.3.3. 1  Design  of  the  Student  Delivery  Treatr.«nt 

Unc  »r  this  treatment,  the  parent  questionnaires  were  sent  to  the 
school  together  with  the  student  questionnaires  and  '  ^st  booklets 
approximately  on*  month  prior  to  Survey  Day.    The  School  Coordinators 
informed  both  verbally  and  in  writing  that  the  Team  Leader  would 
distribute  the  parent  questionnaires  on  Survey  Day.    In  the  Team  Leader 
Manual,  Team  Leaders  rtre  instructed  to  hand  out  parent  questionnaires 
at  the  end  of  the  survey  session.    They  were  told  to  encourage  the 
students  to  ask  th*.  parents  to  promptly  return  the  questionnaires  to 
NORC.    While  the  child  was  instructed  to  give  the  qu.stionnaire  to  the 
parent  who  knew  tb-  most  about  the  child's  education,  instructions  in 
the  letter  that  accompanied  the  parent  questionnaire  also  guided  the 
parent  in  choice  of  the  preferred  respondent. 

4.3.3.2  Implementation  of  Student  Delivery 

In  fact,  all  parent  questionnaires  that  were  to  be  delivered  by 
students  did  arrive  at  the  school  in  the  manner  intended.    However,  in 
a  few  cases,  there  was  apparently  confusion  on  the  part  of  the  School 
Coordinator  about  when  and  how  the  student  should  be  given  the 
questionnaires  to  take  home.    Te^m  Leaders  reported  that  in  at  least 
three  schools,  the  School  Coordinators  setit  the  materials  home  with  the 
children  early.    In  another  case,  the  Team  Leader  handed  out  the  parent 
questionnaires  a  week  prior  to  Survey  Day  on  the  Orientation  Day. 
While  we  were  concerned  that  this  change  of  procedure  might  result  in  a 
higher  incidence  of  denial  of  permission  for  student  participation, 
these  fears  were  apparently  unfoonded.      All  four  schools  that  deviated 
in  this  manner. f rem  the  prescribed  procedure  used  the  implied  consent 
form  for  gathering  parental  permission.    In  one  of  the  schools  theie 
was  no  denial  of  permission,  in  another  there  was  a  single  denial  of 
permission,  in  the  other  two  there  were  two  denials  of  permission 
each  (one  of  which  was  later  converted).    These  denial  rates  are  in 
the  same  range  as  those  of  schools  that  die  follow  the  prescribed 
procedure. 

4.3.4  Mail  Delivery  -  Two  Types:  School  Mail  and  Central  Offic^  Mail 

4.3.4.1     Request  For  Parent  Name3  and  Addresses 

Under  the  mail  delivery  treatment,  whether  the  mailing  would  be 
done  *ron  NORC  or  from  the  school  was  determined  by  whether  or  not  the 
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school  wit  willing  to  provide  NORC  with  parent  names  and  addresses.  If 
the  school  was  willing  to  provide  addresses,  NORC  mailed;  ii  not,  the 
school  was  asked  to  mail.    This  matter  was  first  addresjed  in  the 
initial  contacts  with  the  principal  and  the  School  Coordinator.  (At  a 
point  prior  to  sanding  parent  questionnaires  to  the  schools  assigned  to 
student  delivery,  schools  with  the  latter  treatment  were  also  asked  if 
they  would  have  been  willing  to  provide  addresses.    Of  the  16  schools 
so  assigned,  exactly  half  answered  affirmatively.^ 

Well  in  advance  of  Survey  Day,  at  the  time  at  which  the  school  was 
sent  student  and  parent  letters  of  information  and  parental  permission 
forms,  the  School  Coordinator  was  sent  a  roster  form  in  which  to  fill 
in  parent  names,  addresses  and  telephone  numbers.    An  accompanying 
letter  explained  how  the  form  should  be  completed  (see  Appendix).  The 
School  Coordinator  was  specifically  asked  to  provide  the  address  at 
which  the  child  resided.     A  postage-paid  envelope  was  provided  for 
return  of  the  roster  to  NORC. 


4. 3. 4c 2     Lack  of  Willingness  to  Provide  Parent  Information 

Of  the  18  schools  that  were  assigned  the  Mail  Treatment,  five 
declined  to  provide  NORC  with  parent  names  and  addresses  and  therefore 
were  assigned  to  the  School  Mail  treatment.    In  none  of  the  five  cases 
did  the  School  Coordinator  object  to  having  the  school  do  the  mailing. 

The  reasons  the  five  School  Coordinators  gave  for  not  wishing  to 
release  parrnt  information  were:  (a)  the  procedure  was  against  school 
policy  (4  cases)  and  (b)  *ear  of  parent  objection  (1  case).      No  strong 
effort  was  made  to  convert  schools  in  this  matter. 


4.3.4.3      Central  Office  Mailing 

4.3.4.3.1     Design  of  the  Central  Office  Mailing  Treatment 

Originally  the  parent  packets  were  to  be  mailed  from  NORC  on  Survey 
Day.    After  it  became  apparent  that  early  mailing  had  little  or  no 
effect  on  permissions,  we  decided  to  mail  the  packets  one  week  in 
advance  of  Survey  Day  to  allow  greater  time  for  follow-up  on  unreturned 
questionnaires. 

4.3. '0. 2      Implementation  of  Central  Office  Mailing 

While  in  general  Central  Office  mailings  went  smoothly,  there  were 
isolated  problems.    When  filling  in  the  parent  address  form3,  some 
School  Coordinators  failed  to  provide  zip  codes  or  apartment  numbers. 
Such  omissions  resulted  in  substantial  delays  in  delivery  of  materials, 
particularly  when  the  parents'  last  names  differed  from  that  of  :he 
child. 
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4.3.4.4     School  Mailing 


4.3.4.4.1     Design  of  the  School  Mail  Procedure 

When  a  School  Coordinator  informed  the  NORC  contact  that  the  school 
would  not  provide  NORC  with  parent  information,  the  Coordinator  was 
asked  if  the  school  would  be  willing  to  provide  address  labels  and  mail 
the  questionnaires  on  Survey  Day.    Questionnaires  that  were  to  be 
delivered  to  parents  in  this  manner  were  enclosed  in  the  box  that 
contained  the  student  questionnaires  and  tests.    Each  packet  was  put 
into  a  postage-paid  mailing  envelope.    To  ensure  that  the  Coordinator 
did  not  attempt  to  mail  to  one  particular  parent  of  each  child  and  to 
make  certain  that  each  set  of  parents  received  the  questionnaire  for 
their  child,  a  label  that  read:  [TO  THE  PARENTS  OP:  (Name  of  Child)] 
was  placed  in  the  middle  of  the  envelope. 


4.3.4.4.2     Implementation  of  the  School  Mailing 

Even  though  the  questionnaires  were  sent  to  the  school  in  a  box 
that  the  School  Coordinator  should  only  have  checked  for  contents  and 
stored,  some  School  Coordinators  were  overzealous.    In  two  schools,  the 
Coordinators  removed  the  parent  questionnaires  from  the  box  and  mailed 
the  questionnaires  to  the  parents  early.    Again,  this  apparently  had  no 
negative  effects  on  the  granting  of  parental  consent  for  student 
participation  in  the  study.    In  one  school  there  was  only  one  denial  of 
parental  permission,  while  in  the  other  there  were  two  denials.  Also, 
both  schools  emerged  with  exceptionally  high  Parent  Survey 
participation  rates. 


4.3.5.0     Analysis  of  the  Results  of  Using  the  Three  Methods 

In  evaluating  the  results  of  using  respectively  the  Student  Take 
Home,  Central  Office  Mail,  or  School  Mail  modes  for  parent 
questionnaire  delivery,  three    riteria  will  be  considered:  (1)  the 
number  of  remails  that  were  aone  under  each  treatment;  (2)  early  pe.iod 
and  later  period  parent  participation  rates;  and  (3)  the  Quantity  and 
qualiv  o£  the  data  received  under  the  three  methods  (represented  by 
respondent  non-response  to  two  sensitive  question  items  as  reflected  in 
retrieval  rates  on  those  items.) 


4.3.5.1    Remailing  Under  the  Three  Treatments 

Respondents  were  sent  a  second  copy  of  the  parent  packet  if: 


(1)  They  called  "Chris  Rodgers"  and  reported  that  they 
had  not  received  a  questionnaire  or  had  lost  a  copy  they 
had  received. 
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(2)  They  noted  to  a  telephone  interviewer  during  the 
prompting     11  that  they  diJ  not  have  a  copy  of  the 
questionnaire,  but  would  fill  out  the  questionnaire  when 
a  new  copy  was  tent  to  then. 

(3)  They  and  other  parents  of  a  particular  school  had 
not  recei  »ed  the  questionnaires  because  cf  a  systematic 
error  that  was  discovered  either  in  the  course  of  the 
prompting  (several  parents  reported  not  havrng  received 
a  questionnaire)  or  while  investigating  a  peculiarly 
weak  rate  of  return  of  questionnaires  (no  questionnaires 
were  received  ten  days  after  Survey  Day). 

(4)  The  post  office  returned  the  original  Parent  Packet 
to  NORC  and  information  was  available  from  the  student 
locator  pages  or  elsewhere  that  made  probable  a  more 
successful  mail  attempt. 

The  following  table  summarizes  the  remailing  done  at  NORC  under  the 
three  delivery  methods  for  a  selected  sample  of  schools  (See  NOTE  below 
the  cable).    The  numerators  sum  the  number  of  remailings,  while  the 
denominators  sum  the  number  of  students  who  attended  the  schools' 
Survey  Days  or  Make-Up  Days.    In  no  sense  do  the  rates  shown  represent 
the  number  of  remailings  required  to  assure  that  a  questionnaire  was 
received  by  every  targeted  parent.    Due  to  the  short  duration  of  the 
Parent  Pol low-Up,  cases  for  some  eleven  schools  were  not  subject  to  the 
full  range  of  follow-up  procedures.    Some  of  the  cases,  especially 
those  of  schculs  with  later  Survey  Days,  were  never  even  successfully 
orompt^d;  thus,  it  is  not  possible  to  know  if  a  questionnaire  arrived 
in  all  cases.    Nevertheless,  the  figures  are  interesting  in  that  they 
show  little  variation  among  methods  in  percentage  of  remailings  made. 
This  is  surprising  as  our  expectation  was  that  the  Student  Take  Home 
treatment  would  necessitate  a  high  rate  of  remailing. 

It  may  be  unwarranted  to  conclude  that  having  an  eighth-grader  take 
a  questionnaire  home  is  the  most  dependable  means  of  having  a 
questionnaire  arrive  at  the  home.    In  two  of  the  schools  using  the 
Student  Take  Home  treatment,  there  were  an  especially  large  number  of 
telephone  interviews  done  (ten  in  one  case,  eleven  in  the  other).  If 
the  parents  in  these  cases  also  had  not  received  a  questionnaire,  then 
the  figures  concerning  quantity  of  remailir^s  could  be  mittleading. 
However,  in  checking  the  proportion  of  combined  telephone  and  field 
interviews  done  for  this  particular  group  of  schools  overall,  we  find 
very  litrle  difference  between  the  Student  Take  Home  and  the  Central 
Office  Mail  methods:  35/397  or  8.8  percent  for  Student  Take  Home  and 
19/244  or  7.8  percent  for  Central  Office  Mail. 
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TABLE  4*1 

NUMBER  OP  REMAILS  MADE  UNDER  THE  THREE  DELIVERY  METHODS 


METHOD  #  IN  TREATMENT     #  REMAILS  PERCENTAGE 

OF  REMAILS 

(1)  STUDENT  TAKE  HOME:  397  34  8.6Z 

(2)  SCHOOL  MAIL:  156  15  9.6Z 

(3)  CENTRAL  OPPICE  MAIL:       244  26  10. 7X 

[NOTE:  Some  potential  parent  cases  were  omitted  from  the  calculations 
listed  above,  namely,  (a)  those  in  which  a  precautionary  remailing  was 
made  to  all  parents  in  the  schools  when  systematic  address  errors  were 
discovered  (two  schools,  both  Central  Office  Mail:  School  49  with  31 
cases  and  School  68  with  13  cases)}-  (b)  Make-Up  Day  cases  of  one  school 
(School  03)  that  was  designated  for  Stwuent  Take  Home  treatment,  but 
for  which  the  16  Make-Up  Day  cases  were  mailed  from  the  NORC  Central 
Office;  (c)  those  of  tue  New  York  City  public  schools  (one  Student  Take 
Home:  School  54  with  24  cases  and  two  Central  Office  Mails:  School  55 
with  24  uses  and  School  56  with  29  cases),  which  received  exceptional 
remail  treatment,  as  will  be  described  in  a  future  section.] 


4.3.5.2    Thrc  -Week  and  Pinal  Response  Rates  Under  the  Three  Treatments 

On  average  53.3  percent  of  the  Student  Take  Home  questionnaires 
were  received  in  the  Central  Office  by  the  third  week  after  Survey  Day, 
while  47.7  percent  of  the  Central  Office  Mail  questionnaires  and  59.6 
percent  of  the  School  Mail  questionnaires  were  received  in  house  after 
that  time  span.    This  encompasses  the  same  selection  of  cases  that  were 
treated  in  the  examination  of  remailings  (see  4.3.5.1  above).  The 
numerator  here  represents  the  sum  of  questionnaires  received  by  NORC, 
while  the  denominator  represents  the  sum  of  selected  students  who  were 
actually  surveyed. 

There  is,  within  each  treatjusnt  group,  a  full  range  of  three-week 
return  response  rates,  f<*om  very  low  to  very  high.    In  addition,  one 
should  avoid  interpreting  the  higher  response  rate  for  School  Mail  as 
strong  evidence  that  this  is  the  superior  treatment.    As  noted  earlier, 
only  five  schools  were  included  in  this  treatment,  and  all  were  there 
by  virtue  of  self-selection.    Furthermore,  not  only  could  the  small 
numbers  involved  create  misleading  results;  it  is  also  the  case  that  in 
one  of  the  schools  (School  04),  the  School  Coordinator  had  the  students 
;eturn  their  parents1  questionnaires  to  him  and  he  presented  all  but  a 
few  of  the  questionnaires  to  the  Team  Leader  on  Survey  Day. 

Again,  it  is  intet2sting  how  close  together  the  rates  are  for 
Student  Take  Home  and  Central  Office  Mail.  The  numbers  for  these 
groups  (denominators  respectively  397  and  244)  are  fairly  large  and  it 
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appears  chat  Student  Take  Home  is  not  at  a  disadvantage  when  compared 
to  Central  Office  Nail  by  this  criterion. 

Later,  particular  attention  will  be  given  to  the  problems 
encountered  in  doing  Parent  Survey  Pol  low-Up  in  New  York  City  Public 
Schools*    At  this  point,  we  might  note  that  the  three-week  response 
rate  in  the  one  New  York  City  Public  School  that  had  a  Student  Take 
Home  treatment  was  29.2  percent;  those  for  the  two  New  York  City  Public 
Schools  using  the  Central  Office  Mail  treatment  were  respe  '  ively 
37.9  percent  and  37.5  percent*  [Again,  what  is  being  considered  is 
number  of  questionnaires  in-house  as  a  fraction  of  the  number  of 
eligible  students  who  were  surveyed*] 

Next  we  will  consider  the  response  rates  under  the  three  delivery 
treatments  that  were  achieved  at  a  later  period  of  the  field  test. 
Specifically,  we  will  discuss,  now  for  ALL  schools  in  the  Parent  Survey 
sample,  the  rates  that  had  been  reached  by  May  10th,  the  cut-off  date 
for  the  arrival  of  questionnaires  that  would  be  data  entered*    On  that 
date,  775  questionnaires  had  been  received  in  house*    Response  rates 
have  been  figured  with  two  different  bases,  considering  as  potential 
respondents  this  parents  of  all  children  who  were  eligible  to  have 
participated  in  Survey  Day  or  Make  Up  Day  (Formula  I)  and  considering 
as  potential  respondents  only  the  parents  of  children  who  actually 
participated  in  either  Survey  Day  or  Make  Up  Day  (Formula  II). 

(1)  PARENT  PARTICIPATION  RATES  BY  QUESTIONNAIRE  DELIVERY  TREATMENT 

Formula  I  (Base  =  all  parents  of  children  who  were  eligible 
to  participate  in  Student  Survey) 

STUDENT  TAKE  HOME:         363/440  =  82.5Z 

CENTRAL  OFFICE  MAIL:      279/402  =  69. 4Z 

SCHOOL  MAIL:  136/157  =  86*6% 

Given  the  wide  discrepancy  between  rates  for  Student  Take  Home  and 
Central  Office  Mail,  it  may  be  of  interest  to  consider  the  Central 
Office  Mail  and  School  Mail  cases  in  combination: 

COMBINED  MAIL  TREATMENT:  415/559  =  74. 2Z 

Since  all  three  of  the  New  York  City  Public  Schools  had  especially 
low  response  rates  and  two  of  the  three  were  Central  Office  Mail 
schools  while  the  other  «tas  a  Student  Take  Home  school,  it  is  useful  to 
examine  what  happens  to  the  Central  Office  Mail  and  Student  Take  Home 
rate  differential  if  the  New  York  City  Public  Schools  are  removed  from 
the  analysis.    Removing  11  cases  in-house  of  28  eligible  students  for 
the  Student  Take  Home  school  (School  54)  and  respectively  10  cases  in- 
house  of  30  eligible  students  and  16  cases  in-house  of  31  eligible 
students  for  the  Central  Office  Mail  schools  (Schools  55  and  56),  we 
have: 
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STUDENT  TAKE  HOME: 


352      *  *  85. 4Z 


CENTRAL  OFFICE  NAIL:         253/339  *  74,62 

Then  again  figuring  Combined  Mail  Treatment,  we  have: 

COMBINED  MAIL  TREATMENT:  389/496  *  78. 4Z 

A  wide  differential  between  the  treatments  still  holds.    It  appears 
that  Student  Take  Home  proved  superior  to  Central  Office  Mail  (with 
School  Mail  back-nip)  as  a  means  of  delivering  parent  questionnaires. 

Next  we  consider  parent  completion  rates  by  Formula  II  —  in  which 
the  denominator  is  based  on  the  child's  participation  in  the  Student 
Survey.    The  Ponaila  I  response  rates  are  useful  tor  seeing  how  many  of 
the  parents  that  we  potentially  could  have  had  in  the  parent  f ample  we 
actually  succeeded  in  getting  to  participate.    However,  parents  of 
students  who  were  either  denied  parental  permission  to  participate  in 
the  study  or  parents  of  children  who  were  absent  from  both  Survey  Day 
and  Make  Day  were  not  targeted  in  the  Parent  Survey  Follow-Up. 
Therefore,  to  assess  the  strength  of  the  follow-up  effort,  it  is  also 
useful  to  look  at  parent  participation  races  of  the  targeted 
population. 

(2)  PARENT  PARTICIPATION  RATES  BY  QUESTIONNAIRE  DELIVERY  METHOD 

PORMULA  II  (Base  =  all  parents  of  children  who  participated 
in  the  Student  Survey) 

STUDENT  TAKE  HOME:         365/415  =  88Z 

CENTRAL  OPPICE  MAIL:      274/363  *  75. 5Z 

SCHOOL  MAIL:  136/146  =  93. 2Z 

COMBINED  MAIL  TREATMENTS:  410/509    =  80. 6Z 

Again  removing  the  relevant  New  York  City  Public  Schools  from 
consideration  we  have: 

STUDENT  TAKE  HOME:         343/381  =  90Z 

CENTRAL  OPFICE  MAIL:      248/310  =  80Z 

COMBINED  MAIL  TREATMENT?:  384/456  =  84. 2Z 

Here  again,  Student  Take  Home  appears  superior  to  both  Central 
Office  Mail  and  the  Combined  Mail  treatments  by  a  wide  margin. 
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4.3.5.3     Differences  Under  the  Three  Treatments  Concerning  the 

Following:  Willingness  of  Respondent  to  Provide  Locator 
Information;  Willingness  of  Respondent  to  Provide  Income 
Information 

Another  criterion  that  can  potentially  inform  a  decision  on  the 
optimal  method  of  delivering  parent  questionnaires  is  whether  or  not 
the  quality  and  quantity  of  the  data  received  with  each  treatment  is 
similar.    A  likely  indicator  of  this  factor  is  the  extent  to  which 
respondents  are  willing  to  provide  information  on  such  sensitive 
subjects  as  personal  identification  (name,  address,  and  telephone 
number)  and  income.    Two  questions  in  the  Parent  Questionnaire  directly 
address  these  two  subject  matters,  respectively  the  Respondent  Locator 
Information  (Q.l-41)  and  the  Pamily  income  Information  (Q.7-1).  These 
particular  questions  were  chosen  for  close  examination  because  they 
represent  two  different  typea  of  sensitivity,  because  both  Overall  had 
high  retrieval  rates  as  compared  to  mpst  other  items  in  the 
questionnaire,  and  because  it  seemed  plausible  that  respondents  could 
vary  in  their  willingness  to  respond  to  these  questions  according  to 
the  ranner  in  which  they  received  a  parent  questionnaire. 

Only  the  firct  609  questionnaires  that  arrived  in  house  were 
potentially  subject  to  retrieval  due  to  the  limited  field  period. 

Of  296  Student  Take  Hone  cases  received,  18  (6.1  percent) 
initially  did  not  provide  Respondent  Locator  Information  and  34 
(11.5  percent)  did  not  provide  Pamily  Income  Information. 

Of  136  School  Mail  cases  received,  6  (4.4  percent)  initially  did 
not  provide  Respondent  Locator  Information  and  13  (9.6  percent) 
did  not  provide  Pamily  Income  Information. 

Of  177  Central  Office  Mail  cases  received,  20  (11.3  percent) 

initially  did  not  provide  Respondent  Locator  Information 

and  41  (23.2  percent)  did  not  provide  Pamily  Income  Information. 

Since  the  number  of  cases  considered  is  not  lar»i,  the  results  of 
this  examination  are  haidly  definitive.    Nevertheless,  there  is  some 
evidence  that  mailing  from  the  NORC  Central  Office  may  have  a  negative 
impact  on  response  as  compared  to  either  mailing  from  the  school  or 
having  the  student  take  the  questionnaire  home  to  the  parents.  In 
fact,  again  because  of  the  small  number  of  cases  involved,  the  response 
rate  for  School  Mail  is  suspect.    Recall  that  only  five  schools  had 
thi*  treatment,  all  were  in  the  treatment  through  self-selection,  and 
in  one  of  the  five  schools,  the  School  Coordinator  had  questionnaires 
returned  to  the  school. 

If  one  assumes  that  the  parent  would  have  no  way  of  knowing  whether 
a  questionnaire  was  mailed  from  the  school  or  NORC,  it  would  seem 
reasonable  to  combine  the  cases  for  the  two  mail  treatments  together. 
Then  it  is  the  case  that  for  the  Overall  Mail  treatment,  of  313  cases, 
26  (8.3  percent)  initially  did  not  provide  Respondent  Locator 
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Information  and  54  (17.3  percent)  did  not  provide  Family  Income 
Information. 

Comparing  the  figures  above  with  those  for  the  Student  Take  Homo 
treatment,  we  discover  that  the  rates  are  still  quite  dissimilar, 
particularly  regarding  Family  Income  Information.    While  it  is 
difficult  to  conclude  anything  definitive  from  this  set  of  comparisons, 
there  appears  to  be  some  evidence  that  "he  Student  Take  Home  treatment 
may  be  superior  with  respect  to  willingness  of  respondent  to  provide 
personal  information. 

4.3.5.4     Summary  of  Advantages  and  Disadvantages  of  the  Three  Methods 

It  would  appear  that  there  are  advantages  and  disadvantages  to 
using  any  of  the  three  questionnaire  delivery  methods  discussed  above. 

Hailing  from  the  Central  Office  certainly  allows  the  best  control 
over  when  and  now  questionnaires  are  mailed.    Unfortunately,  if  there 
are  problems  with  receiving  accurate  addresses,  this  method  may  result 
in  long  delays  in  contacting  the  respondent. 

Hailing  from  the  school,  a  back-up  for  a  refusal  on  the  part  of  the 
school  to  provide  us  with  addresses,  appears  to  have  worked  relatively 
well*    The  treatment  registered  one  of  the  lower  percentage  of  remails, 
the  lowest  percentages  of  omission  of  Respondent  Locator  Information 
and  Family  Income  Information,  the  second  highest  three-week  parent 
response  rate  and  the  highest  later-period  response  rates  (as  figured 
by  both  FORMULA  1  and  FORMULA  II).    None  of  the  above  may  actually  be 
significant  given  the  small  numbers  involved  and  the  method  of 
assignment  to  the  treatment.    Furthermore,  none  of  the  New  York  City 
Public  Schools  employed  this  treatment.     While  too  few  New  York  City 
Public  Schools  cases  were  included  in  the  609  potentially  retrievable 
cases  to  warrant  close  scrutiny  of  the  questionnaires  for  retrieval 
results,  it  is  possible  that  since  parents  in  these  schools  had  rates 
of  refusal  for  child 1 s  participation  in  the  Student  Survey  that  were 
well  above  average,  the  New  York  City  Public  School  group  as  a  whole 
might  also  be  more  inclined  not  to  answer  the  Parent  Questionnaire's 
sensitive  questions.    If  so,  the  School  Mail  treatment  would  be  given 
an  artificial  edge  in  the  retrieval  comparisons. 

Having  the  students  carry  the  questionnaires  home  on  (or  before) 
Survey  Day  overall  registered  a  superior  result.    On  average,  this 
method  of  delivery  had  the  highest  percentage  of  questionnaires 
returned  to  the  NORC  central  office  by  the  end  of  a  three-week  period. 
The  later-period  parent  participation  rates,  fii  ired  either  with  a  base 
of  parents  of  eligible  students  or  a  base  of  parents  of  surveyed 
students,  were  substantially  higher  for  this  method  than  were  the 
respective  rates  for  either  Central  Office  Mail  or  Overall  Mail 
treatments.    Furthermore,  parents  under  this  treatment  seemed  more 
willing  than  those  under  the  Central  Office  Mail  treatment  to  provide 
answers  to  selected  highly  important  questionnaire  items. 
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Potential  advantages  of  using  the  Student  Take  Home  treatment  in 
the  base  year  are  several.    First,  unquestionably  it  would  be  much  less 
expensive  to  send  parent  questionnaires  to  the  schools  by  bulk  mail 
/  than  to  sail  the  questionnaires  to  the  parents  individually.  (The  cost 

of  having  the  school  mail  the  questionnaires  would  be  especially  high 
since  both  the  individual  and  bulk  mail  costs  would  be  incurred.) 
v  Dollars  saved  with  use  of  the  Student  Take  Home  method  could  no  doubt 

be  used  with  much  greater  effectiveness  elsewhere  in  the  base-year 
budget.    Second,  if  the  Student  Take  Home  method  were  used  in  the  base 
year,  we  might  be  able  to  avoid  seeking  parent  address  information  from 
the  schools,  an  activity  that  is  expensive  and  time-consuming.  This 
could  mean,  however,  that  we  would  need  to  wait  until  the  Student 
Locator  pages  arrived  before  we  could  acquire  information  necessary 
for  follow-up  on  unreturned  questionnaires.    Alternatively,  the  needed 
information  could  be  obtained  earlier  from  the  students  themselves, 
perhaps  on  Orientation  Day.    Finally,  surely  some  questionnaires  would 
arrive  in  the  home  by  this  method  th*t  would  not  do  so  under  any  type 
of  mail  treatment.    IXiring  this  field  test,  several  questionnaires  were 
returned  to  NORC  by  the  post  otxice,  many  weeks  after  having  been  sent, 
marked  with  a  designation  of  NO  SUCH  ADDRESS  or  MOVED  -  LEFT  NO 
FORWARDING  ADDRESS.    This  is  a  very  important  advantage. 

4.3.5.5     Recommendations  for  Method/Methods  To  Be  Used  for  Parent 
Questionnaire  Delivery  in  the  Base  Year 

Based  on  what  we  have  learned  in  this  field  test,  it  would  seem 
that  the  highest  overall  response  rates  could  be  achieved  in  the  base 
year  by  maximizing  the  opportunities  for  making  contact  with  parents. 
Assuming  full  flexibility  in  choice  of  delivery  method,  an  optimal 
strategy  would  begin  by  using  the  Student  Take  Home  treatment  in  all 
schools.    The  students  might  be  asked  to  carry  the  questionnaires  home 
before  Survey  Day,  perhaps  on  Orientation  Day.    The  students  could  then 
be  asked  to  return  the  questionnaires  on  Survey    ay  to  the  NORC  Team 
Leader.    This  procedure  should  cut  down  on  the  number  of  questionnaires 
that  end  up  in  the  bottom  of  student  lockers.    In  many  cases,  School 
Coordinators  would  be  willing  to  perform  follow-up  on  outstanding 
questionnaires,  thus  raising  parent  participation  at  low  cost.  In 
those  cases  in  which  the  School  Coordinators  felt  this  task  too 
burdensome,  w«  would  do  the  Parent  Survey  follow-up  completely 
ourselves.    Por  qrastionnaires  that  remained  outstanding  after  Survey 
Day,  we  could  initiate  the  same  schedule  of  follow-up  that  apparently 
proved  so  successful  in  the  field  test. 

4.4       Receipt  Control 

The  next  facet  of  the  data  collection  that  will  be  examined  is 
receipt  control,  for  which  both  manual  and  automated  systems  were  used. 

4.4.1     The  Manual  Receipt  Control  System 

Originally  the  manual  receipt  control  system  for  the  Parent  Survey 
was  designed  to  serve  as  a  temporary  measure  until  the  Survey 
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Management  System  (SMS)  could  be  brought  on  line.  However,  even  after 
the  SMS  became  operational,  manual  receipt  control  was  continued,  both 
as  a  check  on  the  accuracy  of  the  SMS  and  because  in  some  cases  it  was 
able  to  serve  functions  that  the  SMS  could  not. 

The  following  procedure  was  used  to  track  questionnaires:    When  the 
daily  mail  arrived,  the  receipt  control  clerk  opened  the  envelopes 
containing  the  nerj  parent  questionnaires  and  wrote  the  day's  date  in 
the  upper  right-hand  corner  of  each  questionnaire.    After  recording  the 
date  of  arrival  of  each  case  on  the  appropriate  school's  student 
roster,  the  clerk  entered  all  cases  on  a  Daily  Take  Repeat.    This  she 
delivered  to  the  Supervisor  of  the  Telephone  Shop  (who  wouxd  use  the 
Report  to  delete  completed  cases  from  the  interviewers c  assignments). 
Next,  the  questionnaires  were  edited  (this  function  will  be  described 
in  a  later  section).    For  all  questionnaires  that  needed  retrieval,  the 
clerk  entered  case  numbers  on  a  Telephone  Shop  transmittal  form.  She 
also  entered  the  same  numbers  on  a  log  which  tracked  the  in-house 
status  of  questionnaires.    When  questionnaires  did  not  require 
retrieval,  the  clerk  gave  the  questionnaires  to  her  Supervisor  to  be 
checked  for  editing  errors.    Questionnaires  were  then  coded  (this 
activity  is  also  described  in  the  next  section).    Following  coding,  the 
receipt  control  clerk  entered  case  numbers  on  a  DATA  PROCESSING 
transmittal  form  and  logged  out  each  case  on  the  in-house  status  sheet 
to  DATA  PROCESSING.    Retrieval  cases  returned  from  the  Telephone  Shop 
were  subject  to  the  same  set  of  procedures.    After  questionnaires  were 
computer-entered  and  returned  from  DATA  PROCESSING,  the  clerk  entered 
the  case  numbers  with  a  status  of  ARCHIVE  on  the  in-house  status  sheet 
and  filed  the  hard-copy  questionnaires  by  school  number. 

4.4.2     The  Survey  Management  System 

NORC's  Survey  Management  System  (SMS)  was  adapted  for  the  NELS:88 
field  test  in  order  to  provide  automated  receipt  control  functions. 
The  system  contained  a  record  for  each  student  in  eighth,  tenth,  and 
twelfth  grades  in  the  survey.    A  number  of  school-level  and  sampling 
variables  were  included  in  each  student  record,  as  was  a  field  for 
recording  the  status  of  student  questionnaire  and  test  data.  In 
addition,  the  recorc3  of  students  in  Parent  Survey  schools  contained 
fields  that  tracked  the  various  methods  used  in  that  component  of  the 
field  test  (such  as  type  of  distribution  used),  parent  questionnaire 
completion  rates  and  the  status  of  in-house  processing. 

Reports  uiing  all  of  these  components  were  generated  for  the 
project  routinely.    Users  were  able  to  view  reports  on-line,  at  their 
own  micronetwork  stations,  or  in  hardcopy  form.    Copies  of  all  reports 
are  included  in  the  Appendix.      Note  in  particular  reports  4  and  5, 
which  display  parent  completion  rates  by  student  completion  rates  and 
parent  completion  rates  by  the  status  of  in-house  processing  steps. 

Customised  reports  and  case-level  lists  were  also  generated  by  the 
SMS.    For  example,  lists  of  all  students  or  parents  in  a  ochool  and 
their  current  status  in  the  survey  were  useful  in  reconciling  manual 
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records  with  the  system.    Finally,  the  SMS  was  used  to  reconcile 
project  records  with  the  questionnaire  data  files  before  final  tapes 
were  produced. 

4.4.3     Base  Year  Survey  Receipt  Control 

The  magnitude  and  complexity  of  the  Base-Year  NELS:88  Parent  Survey 
will  require  significant  enhancements  to  NORC's  SMS.    The  adapted 
system  will  have  a  hierarchial  structure  to  accommodate  several  laye. 3 
of  gatekeepers  (districts,  schools,  parents).    It  will  contain 
personnel  and  locator  data  on  districts  and  schools,  as  well  as  a 
scheduling  component  linking  each  school's  desired  Survey  and  Make-Up 
Dates  to  NORC  field  staff.    At  the  respondent  level,  students  will  be 
linked  to  parents  as  well  as  schools. 

The  SMS  served  the  project  well  during  the  small  field  test.  It 
also  provided  project  staff  with  experience  in  manipulating  and 
interpreting  relevant  variables.    This  experience  has  already  begun  to 
inform  the  design  of  the  more  sophisticated  system  that  will  be  used  in 
the  Base -Year  Survey. 

4.5      Editing/Coding/Data'  Entry 

m 

The  next  saction  of  this  chapter  focuses  on  the  editing  and  coding 
aspects  of  the  Parent  Survey.    It  also  briefly  describes  the 
preparation  of  the  data  for  computer  entry. 

4.5.1      Description  of  the  Editing  and  Coding 

Essentially,  the  editing  function  encompassed  marking  critical 
items  for  retrieval.    Critical  ite*s  are  data  elements  considered  by 
the  study1 s  designers  to  be  of  major  significance  for  analysis  or 
locating  purposes.    Any  such  items  that  were  missing  or  improperly 
answered  in  a  given  questionnaire  were  to  be  checked  off  jn  a  list  of 
critical  items.    The  list  was  then  placed  inside  the  front  cover  of  the 
questionnaire  and  the  two  items  were  sent  to  the  Telephone  Shop  for 
retrieval  of  the  needed  information. 

The  coding  function  was  performed  not  only  by  the  editor/coder,  but 
also  by  the  telephone  interviewers  and  the  field  interviewers.  The 
interviewers  w».re  instructed  to  mark  particular  codes  next  to  the 
relevant  column  numbers  in  the  questionnaire  when  a  respondent  either 
refused  to  answer  a  critical  item  (7)  or  did  not  know  the  answer  to  a 
critical  item  (8).    The  editor/coder  used  these  same  codes  if  the 
respondent  wrcte  in  a  note  indicating  one  of  these  dispositions.  If, 
within  a  critical  item,  some  portion,  say  in  the  locator  information, 
was  not  to  be  retrieved  if  missing,  the  editor/coder  marked  another 
code  for  missing  items  (9).    Coders  used  ($)  to  designate  an 
illegitimate  multiple  response. 
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4.5.2     Treatment  of  Critical  Items 


Two  important  purposes  of  the  field  test  of  the  Parent  Survey  were 
to  discover  difficulties  respondents  had  in  answerir $  questions  and  to 
gather  parent  data  to  inform  both  analysis  and  future  follow-up 
efforts.    While  it  was  important  to  try  to  keep  information  given  by 
the  respondents  in  as  unedited  a  condition  as  possible  for  the  first 
purpose,  it  was  as  important  to  ascertain  if  the  respondents  would  be 
willing  to  provide  answers  to  the  more  critical  of  the  study's 
questions.    Therefore,  although  retrieval  was  performed  for  a  selected 
number  of  critical  items,  we  tried  to  preserve  information  on  the 
original  absence  of  response  on  such  items.    We  kept  a  tally  of  how 
many  times  particular  critical  items  required  retrieval  and  instructed 
telephone  interviewers  to  use  red  pencil  when  adding  to  the 
questionnaire  information  acquired  i*  the  retrieval  call.    In  addition, 
a  group  of  166  questionnaires  that  arrived  in  the  later  part  of  the 
period  were  not  eligible  for  retrieval  at  all.    That  is,  responses  in 
those  questionnaires  were  maintained  in  the  original  condition. 

4.5*3     Summary  of  Items  Requiring  Heavy  Retrieval 

Por  the  609  cases  subject  to  retrieval,  the  following  table  lists 
those  critical  items  that  were  most  often  marked  for  retrieval.  [A 
list  of  all  critical  items  is  provided  in  Part  B  of  this  chapter.] 
Locator  items,  needed  for  the  First  Pollow-Up,  and  non-locator  items, 
which  will  appear  on  the  public-use  data  tape  for  the  base  year  are 
grouped  separately.    Generally,  the  list  includes  all  critical  items 
that  were  sent  for  retrieval  at  least  25  times,  that  is,  that  had  a 
greater  than  four  percent  retrieval  rate.    Items  that  had  lower 
retrieval  rates  are  included  when  these  are  of  particular  interest. 


TABLE  4-2 
CRITICAL  ITEMS  WITH  HEAVY  RETRIEVAL 


LOCATOR  ITEMS: 


Q.# 


Label 


#  Times  Checked 


Summary 


1-41  RESPONDENT 
LOCATOR 
INFORMATION 


39 


This  asked  tne  n&me,  address  and 
telephone  number  of  the 


respondent.    Respondents  often 
told  interviewers  they  didn't 
think  NORC  needed  the  inform- 
ation. 


1-42  RELATIVE 
LOCATOR 
INFORMATION 


106 


This  asked  the  name,  address  and 
telephone  number  of  a  relative  of 
the  respondent.  Respondents 


often  said  they  didn't  want  NORC 
to  disturb  a  relative; 


foreign-bom  respondents  often 
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reported  they  had  no  relative  in 
the  United  States. 

1-44  CHILD'S 

FUTURE  HIGH 
SCHOOL 

47 

This  asked  the  name,  address  and 
telephone  number  of  the  high 
school  the  parent  expected  the 
the  child  to  attend.  On 
retrieval,  most  parents  said  they 
did  not  know  where  the  child 
would  attend  high  school. 

MOM- LOCATOR  ITEMS: 

Q.#  Label 

#  Timet 
Checked 

Summary 

1-9  respondent's 

ORIGIN  OR 
DESCENT 

37 

This  asked  the  respondent  to 
classify  his/her  origin  or 
descent.    The  basic  classific- 
ation was  among  Hispanic  or 
Spanish  /  Asian  or  Pacific 
Islander  /  Neither  Hispanic  nor 
Asian  or  Pacific  Islander. 
Answers  respondents  provided 
to  open-ended  portions  of  the 
question  indicated  confusion. 
For  example,  they  sometimes 
listed  non-Hispanic  countries 
when  filling  in  Other  Hispanic 
as  a  response. 

1-34  WORK 

12  (1) 
11  (2) 
15  (3) 

This  was  a  three-part  question. 
The  first  part  asked  if  the 
respondent  was  presently  working 
full-time.    If  so,  there  was  a 
skip  to  the  next  question.  If 
not,  the  second  part,  asked  what 
the  respondent  was  doing 
(Unemployed,  looking  for  work; 
Unemployed,  not  looking  for  work; 
Retired,  etc.)    The  third 
question  asked  if  the  respondent 
had  ever  had  a  regular  job. 

1-35  PRESENT  OR 
MOST  RECENT 
JOB 

20  (b) 

This  question  with  two 
critical  parts  (b)  and  (f)  asked 
about  the  respondent1 *  present  or 
most  recent  job.    Ine  first  part 
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2-4  CHILD'S 
HEALTH 
PROBLEMS 


3-12  CHILD'S 
PROGRAMS 1 
SERVICES 


7  1  FAMILY 
INCOME 


7-6  SAVINGS 
FOR 

CHILD'S 
EDUCATION 


25  (f) 


30 


31 


74 


36 


3-  (a) 

65  (b) 
69  (c) 


was  an  open-ended  question  which 
asked  what  kind  of  work  the 
respondent  normally  did.  The 
second  criticil  part  asked  the 
respondent  to  categorise  his/her 
job  using  a  long  list;ng  o 
occuration  groups* 

This  asked  about  health 
problems  the  child  has.  In 
retrieval  it  was  discovered  that 
this  vas  often  not  answered 
because  the  child  had  none  of  the 
problems  listed. 

This  asked  if  the  child 

enrolled  in  certain  special 
programs/services.    Again,  it 
often  was  not  answered  if  none  of 
the  choices  applied. 

This  asked  the  amount  of  che 
the  family's  income  for  t*  past 
year.    Most  omissions  here  were 
deliberate. 

This  question  had  four  critical 
parts.    The  first  asked  if  the 
respondent,  the  spouse,  or  the 
child's  custodial  parent  or 
guardian  had  done  anything 
specific  to  have  some  money  for 
the  child's  education  aftd  nigh 
school.    The  next  part  (a)  asked 
if  the  respondent  had  any  of  a 
variety  of  financial  options  as  a 
means  for  saving  for  the  child's 
education.    Parts  b  and  c  of  the 
question  asked  respectively  about 
the  amount  of  money  that  the 
respondent  has  set  aside  fo~  the 
child's  future  educational  needs 
and  about  the  amount  of  money 
that  the  respondent  expects  to 
have  se.  aside  for  the  child's 
educational  expenses  by  the  time 
the  child  finishes  high  school. 
The  latter  thre~       :s  of  the 
question  were  c.    i  ,al  only  if 
the  initio1   >art  of  the  question 
was  answer,     in  the  affirmative. 
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4.5.4     Implementation  of  udi  ing/Coding 

The  editor/coder  vat  provided  with  a  manual  of  specific 
instructions  concerning  when  retrieval  should  be  called  for  on  eich 
critical  item.    She  performed  the  editing  and  coding  well  and  made  few 
errors*    The  interviewers  were  much  more  prone  to  error,  mostly  in  not 
completely  coding  all  questions  that  the  respondent  refused  to  answer 
or  answered  "Don't  Know".    This  is  understandable  since  this  method  of 
coding  was  quite  different  from  what  the  interviewers  were  accustomed 
to  doing. 


4.5.5  Recommendations  for  the  Base  Year  Concerning  Editing/Coding 

In  tha  base  year,  the  parent  questionnaires  will  be  ele  ronically 
scanned.    Therefore,  the  editing  and  coding  will  differ  considerably 
from  tbrt  done  in  th:   field-test  year.    Editing  will  still  be  done  to 
identify  items  for  retrieval.    Every  effort  should  be  made  to  remove 
any  ambiguitr  that  field-test  results  reveal  to  exist  in  individual 
questions.    Derisions  will  need  to  be  made  as  to  the  extent  cleaning  of 
data  should  be  done  before  the  scanning  is  performed.    The  possibility 
*oes  exist  to  do  some  of  che  cleaning  of  the  data  by  machine  after  the 
.canning. 

It  appears  that  the  coding  of  "Refusal11  and  "Don't  Knc-"  by 
conventions  unfamiliar  to  the  interviewers  should  not  be  -Jiie  by 
interviewers.    Their  attention  should  be  fully  focused  on  obtaining 
answers.    As  they  are  accustomed  to  do,  interviewers  should  write  in 
"fcefaeal'^and  JjDK"  (for  DON'T  KNOW)  to  the  left  of  the  question  number. 
If  the  "7",  "8",  etc.  codes  are  needed  for  data  entry,  then  the  editors 
should  translate  the  interviewer  comment*  into  these  codes. 

4.5.6  Data  Entry 

Questionnaire  data  were  converted  to  machine-readable  form  using  a 
conventional  key-to-disk  method.    Data  were  then  100  percent  verified, 
that  is,  r    entered  independently  by  a  different  operator,  with  the 
software  comparing  all  fields  for  identity. 

Special  characters  were  entered  to  record  instances  of  multiple 
responses.    Blann  item'  or,  for  critical  items  only,  missing  values 
coded  at  the  edit  phase,  were  captured  exactly  as  tiese  appeared  in  the 
hard-copy  questionnaires.    Theae  sorts  of  problem*  in  the  data  were 
important  to  retain  in  order  to  reveal  ar^as  requiring  instrument 
revision  prior  to  the  Base-Year  Survey.    In  general,  no  machine 
cleaning  was  applied  to  the  field  test  data.    [On*  exception  is 
respondent  locator  data.    In  order  to  assure  an  accurate  and  complete 
locator  database  for  the  First  Follow-Up  field  test,  home  aidress  and 
tc -^phone  information  were  cleaned  for  invalid  or  missing  data  items. 
When  errors  were  fou  i,  computer  records  were  used  to  correct  items 
such  as  zip  and  area  codes  (through  hard-copy  lookup),  keypunch  the 
improved  data  and  add  these  to  the  file.] 
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In  the  Base- Year  Sf-"ey,  instruments  will  be  optically  scanned 
rather  than  keypunched.    The  iata  will  then  ur  iergo  rigorous  machine 
edit.    NOBC  will  consult  closely  with  CES  before  final  cleaning 
specifications  ar*  applied. 

4.6     The  Stages  of  Parent  Survey  Pollow-U 

The  Parent  Survey  Pollow-Up  consisted  of  four  stages  of  effort;  a 
thank-you/reminder  postcard,  a  telephone  prompt  call,  a  telephone 
interview,  and  a  personal  interview.    Each  is  discussed  in  detail 
below. 

4.6.1     The  Thank- You/Reminder  Postcard 

The  first  stage  of  follow-up  was  the  mailing  from  NORC  of  a 
postcard  that  thanked  patents  who  h#4  returnee  the  questionnaire  and 
prompted  parents  who  had  yec  io  mail  in  the  questionnaire*.    On  the 
postcard,  the  fictitious  name  "Chris  Rodgers"  was  given  as  an  NORC 
contact  person  and  the  parents  were  invited  to  call  collect  if  they  had 
not  received  the  questionnaire  or  wished  to  have  questions  answered. 
The  postcard  wui  mailed  ten  days  to  two  weeks  after  the  school's  Survey 
Day. 

Approximately  twenty  "Chris  Rodgers"  calls  were  received  thwt 
specifically  originated  with  receipt  of  the  postcard.    About  half  of 
these  calls  were  simply  checks  on  the  part  o*  respondents  to  make 
certain  that  ti:e  questionnaires  they  had  mailed  had  arrived  in  Chicago. 
Only  two  callers  requested  clarification  of  questions.    The  rest  called 
to  report  that  they  had  not  received  the  questionnaire  and  to  request 
remailing  of  ehe  questionnaire. 


4.6.2       T*e  Telephone  Pol low-Up 

4.6.2.1  Structure  of  the  Telephone  Shop 

The  telephone  shop  was  responsible  for  three  main  tasks:  (1) 
retrieving  on  critical  items;  (2)  making  prompting  calls  to  parents  who 
had  failed  io  return  parent  questionnaires  one  week  after  the  postcards 
were  mailed;  (3)  seeking  and  carrying  out  telephone  administration  of 
the  parent  questionnaire  to  parents  who  failed  to  return  questionnaires 
after  the  telephone  prompt. 

The  shop  was  headed  by  a  Telephone  Shop  Supervisor,  This 
individual  worked  with  a  staff  of  four  part-time  interviewers,  all  of 
whom  were  experienced  NORC  staff.    The  shop  was  in  operation  from  early 
March  until  the  end  of  the  third  week  in  April. 

4.6.2.2  Training  of  the  Telephone  Interviewers 

Interviewers  were  provided  with  an  Interviewer  Training  Manual  and 
a  Quest ion-by-Question  Guide  to  the  Parent  Questionnaire,  both  of  which 
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had  been  specifically  designed  for  telephone  interviewers.  The 
training  manual,  which  had  been  approved  by  the  CBS  Project  Officer, 
covered  such  material  as  general  orientation  to  the  study;  scrip',  s  for 
sulking  retrieval,  prompting  and  interviewing  calls;  answers  to 
questions  parents  could  be  expected  to  ask;  and  advice  on  converting 
parents  who  resisted  being  respondents*    The  "Q-by-Qs"  guided  the 
interviewer  in  converting  the  questionnaire™ which  was  designed  to  be 
self-admir'stered— for  telephone  administration.    They  also  highlighted 
the  criti.ul  items  and  pointed  out  certain  difficulties  in  the 
questionnaire  that  needed  special  consideration  (for  example,  skip 
patterns  that  might  cause  confusion). 

Bach  interviewer  underwent  a  three-hour  training  session,  then  had 
a  coc/  telephone  interview  administered  by  the  Telephone  Shop 
Supervisor.    By  the  time  of  the  training  session,  the  interviewer  was 
expected  to  have  read  the  Interviewer  Training  Manual.    The  session  was 
used  to  ascertain  nhe  interviewer's  understanding  of  the  project 
specific  material  and  to  explain  the  forms  that  would  be  used  in  the 
course  of  the  field  work.    During  the  mock  interview,  the  Supervisor 
assessed  the  interviewer's  familiarity  with  the  survey  instruments  and 
with  the  specifications  in  the  Q-by-Qs. 

4.6.2.3     The  Three  Telephone  Shop  Functions 

This  section  will  examine  the  three  functions  served  by  the 
telephone  shop:  retrieval,  prompting,  and  interviewing. 

4.6.2.3.1  Retrieval 

Ar  noted  in  Section  4.5.1,  once  the  editor  had  checked  off  critical 
items  needing  retrieval  on  the  Edit  Sheet,  that  sheet  and  the 
questionnaire  were  sent  to  the  telephone  shop.    The  Telephone  Shop 
Supervisor  then  assigned  the  case  to  an  interviewer,  who  was  expected 
to  telephone  the  respondent  ind  acquire  the  missing  data. 

4.6.2.3.1.1       Retrieval  Procedures 

Telephone  Interviewers  were  instructed  to  prepare  cajt  each 
retrieval  call  by  checking  questions  in  the  questionnaire  that  appeared 
on  the  Edit  Sheet  to  be  certain  they  understood  the  reison  *jr 
retrieval  on  each  question.    During  their  training,  the  interviewers 
were  specifically  prepared  to  convince  respondents  of  the  desirability 
of  providing  answers  r.o  each  critical  item.    Particular  attention  was 
given  to  arguments  the  interviewers  might  provide  to  obtain  locator  and 
income  information.    However,  while  interviewers  were  prepared  to  be 
persuasive,  "hey  were  also  told  to  make  clear  to  the  respondent  that 
the  study  was  voluntary  and  the  respondent  did  have  the  right  not  to 
answer  any  question  s/he  did  not  care  to  answer. 
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4.6.2.3.1.2  Implementation  of  Retrieval 

Retrieval  activity  vent  fairly  smoothly.    In  general,  as  revealed 
in  the  call  records,  respondents  apparently  offered  no  objection  to 
being  called  for  retrieval  of  information  they  had  not  previously 
provided.    If  they  did  not  care  to  give  the  information  after  the 
interviewer  provided  the  justification  for  needing  that  information, 
they  simply  said  so. 

Only  the  first  609  cases  received  were  subject  to  retrieval.  It 
would  have  been  inefficient  both  in  terms  of  time  and  cost  to  have 
maintained  the  telephone  shop  past  the  time  that  it  was  closed.  Of 
these  609  cas~«,  268  were  sent  to  the  telephone  shop  for  retrieval. 
The  Telephone  Shop  Supervisor  reported  that  all  but  11  of  the  268 
respondents  were  successfully  contacted. 

4.6.2.3.1.3  Analysis  of  Success  in  Retrieval  of  the  Respondent 
Locator  Information  and  the  Family  Income  Information 

Rates  of  successful  retrieval  on  two  of  the  more  often-unanswered 
Critical  Items,  namely  the  locator  information  on  the  respondent 
(Q.1.41)  and  the  family  income  information  (Q.7.1),  are  given  below: 

Question  1.41:  Of  39  instances  in  which  this  item  was  sent  for 

retrieval,  the  information  was  successfully  retrieved  33 
times.    Retrieval  rate  *  84. 6Z 

Question  7.1:  Of  74  instances  in  which  this  item  was  sent  for 

retrieval,  the  information  was  successfully  retrieved  33 
times.    Retrieval  rate  *  44. 61 

Not  surprisingly,  respondents  offered  the  greatest  resistance  to 
the  income  question.    People  might  have  a  wide  range  of  reasons  why 
they  would  not  wish  to  report  their  income. 

The  high  retrieval  rate  on  the  first  of  the  two  questions  could 
well  be  due  to  the  fact  that  the  interviewer  who  was  on  the  phone  with 
the  respondent  already  had  perhaps  the  most  sensitive  portion  of  the 
respondent  locator  information,  that  is,  the  respondent's  telephone 
number.    If,  in  a  given  questionnaire,  only  this  question  was  marked 
for  retrieval ,  one  could  argue  that  a  retrieve?  call  might  not  have 
been  necessary.    Frequencies  calculated  for  the  NELS:88  Field  Test 
Student  Survey  reveal  that  of  1329  eighth-grader*  who  filled  out  the 
Student  Locator  pages,  only  13  (less  than  one  percent)  failed  to  give 
their  mother's  name,  and  only  7  (again  less  than  one  percent)  failed  to 
give  their  own  address.    A  cursory  examination  of  questionnaires 
reveals  that  eighth-graders  do  not  seem  to  !i*v*  any  difficulty  in 
providing  zip  codes.    If  eighth-graders  do  provide  adequate  loca 
information,  it  would  seem  cost  efficient  not  to  telephone  the  c^id's 
home  to  £*ther  information  that  we  effectively  already  have. 
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4. 6. 2,3. 1.4       Suggestions  for  the  Base  Year  Concerning  Retrieval 

Additional  interviewer  training  in  persuasion  may  boost  base-year 
retrieval  rates*    The  number  of  questionnaires  being  senc  for  retrieval 
might  also  be  dramatically  reduced  if  more  lenient  criteria  were  used 
for  determining  the  necessity  of  retrieval.    One  juch  example  might  be 
only  calling  to  gather  respondent  locator  information  if  the 
information  appears  in  neither  the  Parent  Questionnaire  nor  the  Student 
Questionnaire.    Finally,  an  attempt  should  be  made  to  identify 
characteristics — ethn;^fty,  school  sector,  social  economic  statue, 
r  ^ion  types —  associated  with  high  resistance  to  answering  locator  and 
income  information.    Specific  strategies  might  be  devised  for  dealing 
effectively  with  respondents  possessing  these  characteristics. 

4.6.2  > 3. 2.0  Prompting 

The  prompting  telephone  call  was  designed  to  be  a  low-pressure 
reminder  to  the  parent  to  send  in  a  questionnaire  that  was  still  out- 
standing.   It  also  served  as  an  opportunity  to  discover  which  parents 
had  not  received  the  questionnaire. 

Only  parents  whose  children  h*.d  actually  participated  in  Survey  Day 
(or  Make-Up  Day)  were  pursued  by  the  telephone  shop. 

4.6.2.3.2.1       Prompting  Procedures 

The  interviewer  was  instructed  to  ask  for  that  parent /guardian  of 
the  child  most  familiar  with  the  child's  education.    The  interviewer 
then  would  go  on  to  ask  if  the  parent/guardian  bad  yet  filled  out  the 
questionnaire.    If  the  answer  was  negative,  the  interviewer  would 
attempt  to  have  the  respondent  give  a  specific  date  on  which  the 
questionnaire  would  be  mailed.    If  the  respondent  reported  that  the 
questionnaire  had  been  mailed,  the  interviewer  thanked  the  respondent 
for  contributing  to  the  study. 

The  promoting  call  was  scheduled  for  one  week  after  the  mailing  of 
the  prompting  postcard.    Before  cases  were  sent  to  the  telephone  shop, 
face  sheets  for  all  cases  that  were  rot  being  pursued  were  separated 
from  those  that  were  still  eligible  for  a  prompting  call.  Log-bar 
sheets  listing  the  locator  information  provided  by  the  child  about 
himself /herself  and  family  were  annotated  tor  the  current  disposition 
of  the  parent  cases.    The  Telephone  Shop  Supervisor  would  use  these 
log-bar  sheets  to  track  the  activity  on  a  given  case.    The  interviewers 
were  given  face  sheets  containing  the  same  locator  information.  They 
were  also  given  call  records  to  be  used  by  any  interviewer  that  worked 
on  the  case. 

At  the  beginning  of  each  work  day,  the  Supervisor  distributed  cases 
to  be  worked  that  day  to  the  vario  is  interviewers.    The  interviewers 
kept  records  of  how  much  of  their  time  they  spent  with  the  various 
types  of  contacting  they  were  doing.    On  the  call  records  they  recorded 
the  time  and  date  of  each  call  made  and  marked  a  disposition  code  to 
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show  the  state  of  the  contacting*    They  alto  wrote  for  each  contact 
they  had  with  the  household  what  occurred  in  the  course  of  the  call. 
At  the  end  of  the  day,  the  interviewers  returned  the  assignments  to  the 
Supervisor* 

4.6.2.3.2.2  Implementation  of  Prompting 

Prompting  was  highly  effective.    Within  a  week  after  a  particular 
school's  cases  were  prompted,  a  substantial  number  of  cases  for  the 
school  would  arrive  in  house.    While  some  parents  conveyed  a  refusal 
during  the  prompting  call,  most  parents  told  the  interviewers  that  they 
had  not  had  the  time  to  complete  the  questionnaire* 

Individual  cases  were  considered  to  have  come  in  without  prompting 
if  they  arrived  in  house  within  20  days  of  the  school's  Survey  Day. 
Some  43C  cases  or  47  percent  of  ali  potential  cases  met  this  criterion. 
While  all  of  the  rest  of  the  cases  were  theoretically  subject  to 
prompting,  Mew  York  Cit~  Public  Schools  could  not  be  prompted  by  phone 
and,  due  to  the  tightness  of  the  field  test  schedule,  some  of  the  cases 
for  schools  with  later  Survey  Days  were  not  prompted.  Some  indication 
of  what  might  have  been  the  overall  result  if  no  prompting  had  been 
done  can  be  seen  from  the  individual  results  for  some  of  these  later 
schools.    Their  completion  rates  (cases  in-house/potential  cases) 
averaged  in  the  mid-sixties. 

As  will  be  discussed  in  greater  detail  later,  the  parent  cases  of 
eiehteen  of  th»  schools  in  the  sample,  those  that  were  located  in  the 
states  of  California,  Texas,  and  Florida  and  that  had  Survey  Days  in 
the  first  six  weeks  of  the  field  period,  received  a  full  follow-up 
treatment,  including  having  cases  sent  to  the  national  field  staff. 
Looking  at  this  subsample's  pattern  of  return  of  questionnaires  offers 
some  indication  of  what  might  be  exptcted  in  the  base  year  when  ill 
schools  will  receive  the  extensive  follow  up. 

Since  only  parents  of  children  who  actually  participated  in  the 
Student  Survey  were  pursued  in  the  Parent  Survey  follow-up,  response 
rates  in  the  following  analysis  will  be  calculated  by  what  we  have 
previously  called  FORMULA  II,  that  is,  dividing  the  number  of  parent 
questionnaires .received  by  the  number  of  children  surveyed. 

By  the  tine  that  cases  for  these  18  schools  were  sent  to  the  field, 
385  (74.3  percent)  of  518  cases  had  arrived  in  house.    Of  these,  251 
(48.5  percent)  of  the  518  had  come  in  without  prompting,  that  is, 
within  20  days  of  Survey  Day;  112  of  the  518  (21.6  percent)  had  come  in 
following  prompting;  and  22  of  the  518  (4.2  percent)  had  b«en  completed 
by  telephone  administration. 

4.6.2.3.2.3  Evaluation  of  the  Prompting  Effort 

The  telephone  shop  completed  a  total  of  338  prompts.    For  thz  most 
part,  the  prompting  calls  were  made  w  thin  a  week  of  the  time  the 
relevant  cases  became  eligible.    Most  of  the  efforts  were  completed 
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with  just  tvo  or  three  telephone  calls  to  the  household.    The  average 
prompt  call,  including  preliminary  attempts,  took  11  minutes.    This  did 
not  include  the  administrative  work  such  as  filling  in  records  of  calls 
that  the  interviewer  had  to  perform  on  the  case.     Some  cases  required 
as  many  as  tea  or  twelve  calls  and  still  could  not  be  completed.  While 
interviewers  varied  the  times  they  attempted  to  call,  the  fact  that  the 
interviewers  worked  only  eveni  lg  and  weekend  hours  made  much  variation 
of  times  of  contact  difficult.    There  were  some  cases  in  which  someone 
else  in  the  household  informed  the  interviewer  that  the  appropriate 
respondent  could  be  reached  only  during  specific  daytime  hours. 

4.6.2.3.7.4       Recommendations  for  the  Base  Year  Concerning  Prompting 

7i  the  base  year,  as  was  done  in  the  field-test  year,  every  effort 
thould  be  made  to  employ  highly  experienced  telephone  interviewers  who 
are  comfortable  with  refusal  conversion.    The  telephone  interviewers 
represent  MBLS:88  to  a  good  proportion  of  our  parent  respondents. 
Parent  refusals  to  participate  can  and  must  be  avoided  at  the  time  of 
the  telephone  prompting.    An  articulate  and  well-informed  interviewer 
should  be  able  to  allay  most  of  the  fears  that  might  cause  a  respondent 
to  take  a  negative  attitude  towards  the  study. 

Initially  consideration  was  given  to  the  idea  of  having  field 
interviewers  do  the  prompting  and  telephone  interviewing  calls.  The 
experience  of  the  field  test  suggests  that  there  are  several  economies 
to  having  this  initial  work  p« -formed  in  the  Chicago  office.  Perhaps 
the  largest  advantage  is  that  assignment  updating  can  easily  be  done  on 
a  daily  basis.    Also,  any  problems  that  become  evident  during  the 
telephone  calls  can  be  immediately  handled  by  the  Parent  Follow-Up  . 
Supervisor.    Still  a  third  advantage,  assuming  that  the  scale  of  the 
base-year  survey  would  make  feasible  a  day-time  shift  for  interviewers, 
is  that  in-house  interviewer*  could  stagger  times  of  call  attempts 
easier  than  could  field  interviewers  who  would  be  conducting  Student 
Surveys  in  the  daytime. 

There  arte,  however,  strong  advantages  also  to  having  the  fi2ld 
staff  do  at  least  the  telt phone  interviewing  stage  of  the  follcw-up. 
In  a  situation  where  the  field  staff  are  the  same  individuals  who 
conducted  the  Student  Surveys  in  the  schools,  these  interviewers  are 
well  informed  about  the  study,  know  the  region  where  the  parents  live, 
and  are  well  accustomed,  in  most  cases,  to  bringing  about  refusal 
conversions.    Moreover,  a  field  interviewer  would  be  in  the  position  .c 
make  an  immediate  offer  to  schedule  an  in-person  interview  i£  the 
respondent  objected  to  participating  in  a  telephone  interview,,  Jnill 
another  advantage  would  be  the  cost  savings.    Local  telephone  rates  are 
generally  nw~h  cheaper  long  distance  rates.    A  combination  of  having 
the  prompting  and  retrieval  done  in  the  central  office  and  the 
telephone  interviewing  done  in  the  field  would  seem  ideal. 
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4.6.2.3.3.0       Telephone  Interviewing 


The  third  level  of  Parent  Survey  follow-up  was  the  telephone 
interview.    Our  experience  with  this  phase  of  the  follow-up  is 
summarised  below. 

4.6.2.3.3.1       Telephone  Interviewing  Procedures 

When  a  case  was  still  outstanding  one  week  after  a  successful 
prompt,  it  became  eligible  for  telephone  interviewing.    The  telephone 
interviewers  were  also  told  to  attempt  a  telephone  interview  even  at 
the  initial  prompting  contact  if  it  became  apparent  that  the 
respondent  would  not  be  mailing  in  a  questionnaire.    As  with  the 
prompting,  the  interviewer  was  asked  to  contact  that  parent  who  was 
■•est  knowledgeable  about  the  child's  education. 

4*6. 2.3.3.2       Adaptation  of  the  Questionnaire  for  Telephone 
Administration 

As  noted  above,  the  Parent  Questionnaire  was  designed  to  be  self- 
administered.    Therefore  telephone  interviewers  had  to  memorize  any 
changes  that  needed  to  be  made  to  make  the  questionnaire  comprehensible 
when  heard  over  the  telephone.    An  example  of  a  question  that  was 
particularly  troublesome  for  the  telephone  interviewer  was  Question 
1.35F,  which  asked  the  respondent  to  classify  his/her  occupation  from  a 
long  list  of  job  categories.    A  purpose  of  the  *ield  test  was  to 
ascertain  whether  the  respondent  had  difficulty  in  making  such  a 
classification  from  the  given  choices.    It  was  therefore  important  to 
let  the  respondent  have  a  choice  of  categories.    This  particular  issue 
was  settled  for  the  field  test  by  having  the  interviewer  pull  out  three 
or  four  of  the  categories  that  seemed  probable  answers,  given  the 
occupation  the  respondent  had  previously  stated  in  a  related  open-ended 
question,  and  asking  the  respondent  to  choose  among  these.  (Sine  this 
is  a  question  that  often  needed  to  be  retrieved,  it  will  be  necessary 
to  deal  with  this  dilemma  during  the  base  year.    There  will  be  no  open- 
ended  questions  in  the  base-year  questionnaire  and  thus  the  telephone 
interviewer  will  not  have  a  prior  statement  of  occupation  to  guide 
category  choice.    If  a  telephone  interview  version  of  the  questionnaire 
were  made  available  in  the  base  year,  the  open-ended  question  might  be 
added  to  that  questionnaire  to  guide  the  respondent  more  efficiently 
into  a  more  limited  and  appropriate  menu  of  choices.) 

All  in  all,  ever  though  the  self-administered  questionnaire  was 
fairly  simple  in  structure,  it  was  not  easy  to  administer  by  telephone. 
However,  the  experience  of  the  field  test  giv  3  a  strong  basis  for 
developing  specifications  and  training  that  will  facilitate  efficient 
telephone  and  in-person  administrations  of  the  parent  questionnaire. 

4.6.2.3.3.3       Implementation  of  Telephone  Interviewing 

Telephone  interviewing  directly  added  36  cases  to  the  roster  of 
completed  cases.      Another  seven  telephone  interviews  were  obtained  but 
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these  turned  out  to  be  duplicates.    That  is,  the  respondent  offered  to 
-do  a  telephone  interview  when  the  interviewer  said  that  there  was  no 
record  that  the  completed  questionnaire  had  arrived  at  NORC. 

According  to  the  call  records,  mo*t  respondents  heavily  resisted 
doing  a  telephone  interview.    Instead,  they  promised  they  would  send  in 
the  questionnaire  immediately.    Many  of  them  subsequently  did  so.  Thus 
the  interviewing  call  often  turned  into  an  especially  effective  second 
prompting  call. 

Very  few  refusals  were  registered  at  this  stage.    While  the 
interviewers  had  been  trained  to  deal  with  conversion  of  refusals,  what 
they  were  in  fact  mostly  confronting  were  promises  to  send  in  the 
questionnaire  by  mail,  not  refusals.    In  deference  to  respondents9 
preference  for  mail-in  of  the  questionnaire,  interviews  were  not 
aggressively  pursued.    If  the  case  turned  out  co  be  a  "hidden  refusal", 
that  is,  the  promise  to  send  in  the  questionnaire     s  not  kept,  then 
the  case  was  designated  for  field  action. 

The  quality  of  the  telephone  interviewing  work  was  good.  The 
records  of  calls  reveal  that  these  respondents  did  not  complain  that 
the  telephone  interviewing  experience  was  excessively  burdensome.  The 
telephone  interviewers  recorded  the  beginning  and  ending  times  of  each 
interview;  the  average  interview  lasted  44  minutes.    Only  two  partial 
interviews,  those  in  which  only  critical  items  were  asked,  were 
conducted.      There  were  no  breakoffs  by  respondents. 

4.6.2.3.3.4       Recommendations  For  The  Base  Year  Concerning  Telephone 
Interviewing 

If  separate  versions  of  the  questionnaire  for  telephone  and  field 
interviewing  are  not  produced  for  the  base  year,  the  telephone 
interviewer  will  still  have  to  contend  with  the  modifications  necessary 
to  make  the  self-administered  questionnaire  suitable  for  telephone 
administration.    It  should  be  investigated  whether  required 
modifications  are  sufficient  to  justify  the  cost  of  producing  different 
versions  of  the  questionnaire,  given  the  scale  of  the  base-year  follow- 
up.    If  r  telephone-interviewer  edition  is  not  prepared,  a  greater 
amount  of  practice  in  dealing  with  the  modifications  should  be  built 
i.  .o  the  interviewer's  training. 

Parti  ular  attention  should  also  be  given  in  the  training  to 
improving  the  record  of  the  interviewers  with  respect  to  achieving 
telephone  interviews.    Respondents  may  resist  doing  telephone 
interviews,  but  the  fact  remains  that  telephone  interviews  are  much 
cheaper  to  do  than  personal  interviews.    Perhaps  »ome  type  of  incentive 
can  be  built  in  to  encourage  interviewers  to  strenuously  pursue 
telephone  interviews.    Closely  related  to  this  issue  is  the  necessity 
of  hiring  interviewers  who  are  experienced  converters.    As  noted  in 
Section  4.6.2.3.2.4,  serious  consideration  should  be  given  to  assigning 
the  telephone  interviewing  to  .he  field  interviewers. 
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4.6.3.0     The  Field  Follow-Up 


Personal  interviewing  performed  by  highly  skilled  field 
interviewers  who  hed  already  served  as  Team  Leaders  on  the  Student 
Survey  was  the  ultimate  means  used  to  obtain  outstanding  parent 
questionnaire!       This  section  discusses  our  experience  vith  this  phase 
of  the  NELS:88  Parent  Study  Pollow-Up. 

4.6.3.1     Field  Follow-Up  Procedures 

Not  all  schools9  cases  were  subject  to  the  field  follo^up 
treatment.    Due  to  the  short  length  of  the  field  period  and  the 
staggering  of  the  Survey  Days,  it  would  have  been  uneconomical  to  do 
field  follow-up  on  cases  for  schools  which  had  the  later  Survey  Days. 
Thus,  with  a  single  exception,  only  schools  that  had  Survey  Days  during 
the  first  six  weeks  of  the  field  period  were  eligible  for  the  field 
treatment.    The  single  exception  was  a  private  Miami  school  which  had  a 
student  body  that  was  largely  Hispanic.  (Hispanics  are  a  respondent 
group  for  which  we  were  especially  interested  in  studying  response 
characteristics.)    That  school's  Survey  Day  was  held  in  the  seventh 
week.    Of  the  schools  with  Survey  Days  in  the  first  six  weeks,  those 
that  were  located  in  Illinois  and  Hew  York  were  also  eliminated  from 
field  follow-up  treatment.    In  Illinois,  only  a  few  cases  were 
outstanding  for  the  two  schools  eligible.    In  New  York,  each 
interviewer  would  have  dealt  with  a  single  school's  cases.    (In  New 
York  City  Public  Schools,  only  written  follow-up  was  allowed  for  the 
Parent  Survey,  as  will  be  discussed  in  a  later  section.) 

The  Parent  Follow-Up  Supervisor  dealt  directly  with  the  three  Field 
Managers  from  California,  Florida  and  Texas,  all  of  whom  had  previously 
performed  the  Field  Manager  (FM)  function  on  the  Student  Survey.  These 
three  respectively  supervi  ?d  teams  of  two,  three,  and  two 
interviewers.    Although  training  of  interviewers  was  largely  self-study 
— interviewers  were  given  a  Training  Manual  and  a  set  of  Question-By- 
Question  Specifications  (Q-by-Qs)  prepared  especially  for  them—the 
Field  Manager  conducted  a  phone  mock  with  each  of  her  interviewers. 
Immediately  prior  to  the  three-week  field  period,  the  Parent  Pol low-Up 
Supervisor  sent  case  assignments  and  the  call  records  on  each  case 
'irectly  to  the  interviewer.    When  the  field  period  began,  the  PM  took 
sports  from  the  field  and  conveyed  co  the  interviewers  the  updating 
information  received  from  Chicago.    The  FM  also  consulted  with 
interviewers  on  such  matters  as  how  best  to  arrange  their  individual 
field  schedules  and  on  when  to  abandon  work  on  a  case  and  declare  it  a 
final  non-completion. 


4.6.3.2       Adaptation  of  the  Questionnaire  for  Personal  Administration 

The  Question-by-Question  Specifications  prepared  for  the  field 
interviewers  were  similar  to  those  used  by  the  telephone  interviewers. 
The  principal  difference  between  the  two  setz  of  Q-by-Qs  was  that  cards 
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shoving  answer  choices  were  used  cy  field  interviewers  to  ask 
respondents  soaps  of  the  questions.    Here  again,  it  was  necessary  for 
the  interviewer  to  memorize  all  modifications  and  instructions. 


4.6.3.3       Implementation  of  Pield  Pol low-Up 

The  field  follow-up  was  generally  a  success,  although  gone  problems 
wet*  encountered  that  merit  close  examination.    The  following  table 
summarizes  what  was  accomplished.    CASBS  SENT  were  all  outstanding 
cases  for  eligible  schools  in  those  states,  including  those  cases  in 
which  the  respondent  had  conveyed  tc  a  telephone  interviewer  a  refusal 
to  participate  in  the  study.    The  nature  of  the  successful  cases  is 
given  below.    PINAL  HON- COMPLETIONS  included  hostile  and  non-hostil : 
refusals,  "silent  refusals"  (either  the  respondent  promises  to  mail  in 
a  questionnaire  and  does  not  or  the  respondent  is  never  available 
either  in  person  or  by  phone),  non-locatables,  cases  which  were  not 
pursued  by  interviewers  for  lack  of  timt,  and  any  other  response  status 
that  resulted  in  our  not  receiving  a  questionnaire  at  MORC.  The 
particular  dispositions  of  the  PINAL  NON-COMPLETIONS  are  provided  later 
in  rh<t  chapter  in  Section  4.7.3. 

TABLE  4-3 

DISPOSITIONS  OP  PARENT  SURVEY  CASES  SENT  TO  THE  PIELD 

CASES  SENT      SUCCESSFUL  CASES       PINAL  NON- COMPLETIONS 

FLORIDA        52  36  (69.2Z)  16  (30.8Z) 

TEXAS  32  24  (751}  8  <25Z) 

CALIFORNIA    49  29  (59.2Z)  20  (30.8Z) 

Of  the  89  cases  that  were  successfully  completed ,  22  were  telephone 
interviews,  31  were  field  pick-ups  (the  interviewer  went  to  the 
respondent's  hone  to  collect  a  self-administered  questionnaire),  and 
the  remainder  were  mail-ins  subsequent  to  telephone  contact  with  the 
field  interviewer.    Interviewers  who  could  give  sufficient  time  to  the 
assignment  during  the  very  short  three-week  period  generally  were 
highly  successful  in  completing  some  very  challenging  cases,  including 
some  refusals.    It  should  be  noted  that  eight  of  the  non-completions  in 
Florida  were  the  result  of  migrant  workers  leaving  the  area  without 
leaving  forwarding  addresses,  while  eleven  of  the  non-completions 
registered  for  California  could  not  be  efficiently  pursued  because  the 
residences  of  eighth-graders  attending  a  highly  exclusive  private 
school  were  distributed  over  a  forty-mile  radius. 

The  quality  of  the  interview  cases  that  were  done  in  the  field  was 
generally  high,  although,  as  noted  before,  the  interviewers  did  have 
difficulty  doing  the  special  coding  they  were  asked  to  do.  Interviewers 
were  told  that  for  cases  that  were  not  refusals,  they  might  call  the 
respondent  to  arrange  a  time  either  to  pick  up  a  self-administered 
interview  or  to  administer  a  personal  interview.    For  a  field  pick-up 
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case,  the  interviewer  wet  etked  to  do  a  quick  edit  on  the  spot  and  to 
attempt  to  retrieve  on  miffing  answers  to  critical  items.  While 
frequently  the  latter  edit  war  not  done,  often  this  was  because  the 
questionnaire  was  delivered  to  the  interviewer  in  a  sealed  envelope. 

As  with  the  telephone  interviewers,  the  field  staff  were  apparently 
persuasive  in  acquiring  critical  item  material  from  respondents.  An 
examination  of  22  field-interview  and  22  telephone-interview 
questionnaires,  all  for  the  same  set  of  f  hools,  reveals  that  Question 
1.41  (Respondent  Locator  Information)  was  not  answered  by  just  one 
respondent  of  each  type  of  interview.    Moreover,  Question  7.1  (Pamily 
Income  Information)  was  not  also  not  answered  by  only  one  field- 
interview  respondent  and  one  telephone-interview  respondent. 

4.6.3.4     Recommendations  for  the  Base  Year  Concerning  Pield  Pollow-Up 

In  the  base  year,  the  Student  Survey  and  Parent  Survey  Pollow-Up 
should  be  coordinated  in  such  a  manner  that  a  Team  Leader/Interviewer 
can  be  working  on  both  at  the  same  time.    Training  on  the  two  aspects 
of  the  study  can  be  expected  to  inform  and  improve  performance  on  botu. 
Interviewers  should  be  assigned  to  N ELS: 88  full  time.    This  would 
permit  efficiency  in  the  timing  of  the  Parent  Survey  follow-up.  Where 
necessary,  interviewers  could  exchange  parent  cases  with  other 
interviewers  in  the  area  to  assure  that  all  interviewers  have  an  even 
flow  of  work. 

It  would  also  be  beneficial  to  all  involved  if  the  interviewer  and 
her  PM  worked  out  a  specific  schedule  for  completing  the  caseload  that 
would  then  be  approved  by  the  Parent  Pollow-Up  Supervisor.  This  is 
particularly  critical  since  in  all  likelihood,  the  interviewer  will  be 
heavily  involved  with  the  NBLS:88  Student  Survey  at  the  same  time  she 
ic  working  on  the  Parent  Survey.  Again,  the  problem  of  overscheduling 
of  a  given  interviewer's  time  would  be  alleviated  (but  not  eliminated) 
if  interviewers  worked  full  time  on  NELS:88. 


4.7     Analysis  of  Parent  Participation  Rates 

In  order  to  devise  more  effective  contact  and  follow-up  materials 
for  the  base-year  NELSs88  Parent  Survey,  it  is  useful  to  examine  the 
response  rates  of  the  parents  of  the  field-test  sample  under  various 
categorizations.    We  begin  by  presenting  the  final  parent  participation 
rates  for  all  34  schools  in  the  Parent  Survey.    Two  sets  of  completion 
rates  are  given.    One  considers  parents  of  all  students  who  were 
eligible  to  participate  in  the  Student  Survey,  and  the  other  considers 
parents  whose  children  actually  participated  in  the  Student  Survey 
(only  these  were  f ollowed-up).    Next,  we  summarize  these  two  sets  of 
parent  participation  rates  specifically  for  that  subsample  of  18  Parent 
Survey  schools  that  were  subject  to  the  full  four  stages  of  parent 
follow-up.    In  the  thi  d  part  of  the  section,  we  present  a  summary  of 
the  final  case  dispositions  of  those  parent  cases  in  the  18  schools 
that  failed  to  yield  a  completed  parent  questionnaire.    In  a  fourth 
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part,  we  draw  comparisons  of  parent  participation  rates  accord i"^  to 
(1)  Ethnicity  (Hispanic,  Asian/Pacific  Islander,  Core)  (2)  School 
Sector  (Public,  Catholic,  Other  Private),  and  (3)  Parental  Permission 
Required  (Implied.  Explicit).    Finally,  oased  on  the  material  that  has 
been  presented,  w*  offer  suggestions  for  improving  parent  response 
rates  in  the  base  year. 

4.7.1         Presentation  of  Fi^al  Completion  Rates  for  All  Parent  Survey 
Schools 

On  the  following  page,  we  present  the  final  completion  rates  in  all 
HELS:88  Parent  Survey  schools.    Completion  rates  are  calculated  by  two 
formulas,  previously  designated  as  FORMULA  I  and  FORMULA  II.    In  both 
cases,  the  numerator  is  the  number  of  parent  questionnaires  that  were 
obtained  completed.    FORMULA  I  has  as  the  denominator  the  number  of 
students  who  were  eligible  to  participate  in  Survey  Day.  Students 
whose  names  incorrectly  appeared  on  the  student  roster  as  being 
eligible  and  students  who  became  ineligible  (dropped  out,  transferred 
out,  etc.)  between  the  time  the  roster  was  prepared  and  Survey  Day  are 
not  included.    FORMULA  II  has  as  the  denominator  the  number  of  all 
students  who  participated  in  the  Student  Survey  either  on  Survey  Day  or 
Make-Up  Day. 

SUMMARY: 

FORMULA  I: 

Response  Rate  for       N  of  completed  parent  questionnaires 

Parents  of  =   

Eligible  Students       N  of  students  eligible  for  Survey  Day 

FORMULA  II: 

Res  onse  Rate  for       N  of  completed  parent  questionnaires 

Surveyed  Students       N  of  students  actually  surveyed 

As  one  can  be  seen  from  the  table,  very  high  response  rates  were 
obtained  for  most  of  the  schools,  particularly  those  that  were  subject 
to  the  full  follow-up  treatment  (marked  with  an  *).    Two  groups  have 
several  notable  exceptions:  OTHER  PRIVATE  SCHOOLS  (Schools  51,  2,  3, 
37,  and  68)  and  the  NEW  YORK  CITY  PUBLIC  SCHOOLS  (54,  56,  and  55). 

Ihe  summary  statistics  are  as  follows: 

FINAL  PARTICIPATION  RATE  FOR  ALL  PARENT  SAMPLE  SCHOOLS 
FORMULA  I  (Base  =  parents  of  all  children  eligible  to 
participate  in  Student  Survey):  780/999  38  78. 1Z 

FINAL  PARTICIPATION  RATE  FOR  ALL  PARENT  SAMPLE  SCHOOLS 
FORMULA  II  (Base  =  parents  of  all  children  who  participated 
in  Student  Survey):  770/922  =  83. 5Z 
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TABLE  4-4:  PARENT  COMPLETION  RATES  IN  THE  NELS:88  PARENT  SURVEY  SCHOOL 


School    Survey   Number     Number        Percentage    Number  Percentage 


NORC 

Date 

Parent 

of 

Completed 

of 

Completed 

ID 

Quex  In 

Surveyed 

Surveyed 

Eligibles 

Eligibles 

04* 

2/3 

25 

28 

89.2% 

30 

39 

2/3 

29 

30 

96. 7Z 

32 

90. 6% 

73* 

2/3 

24 

27 

88. 9Z 

30 

88. 9Z 

75* 

2/3 

28 

29 

96. 6Z 

31 

90  3Z 

38 

2/5 

25 

29 

86. 2Z 

32 

78.  IZ 

36 

2/10 

17 

17 

100Z 

17 

1  (MX 

SO 

2/10 

31 

36 

86. 1Z 

36 

86.  IZ 

72* 

2/10 

21 

21 

100Z 

26 

80.8^ 

74* 

2/10 

25 

25 

96. 2Z 

32 

78.  IZ 

05* 

2/17 

26 

"6 

100Z 

30 

86. 7Z 

51 

Vl7 

12 

16 

75Z 

17 

70. 6Z 

69* 

2/24 

23 

25 

92  Z 

25 

12* 

2/24 

26 

30 

86. 7Z 

31 

•83. 9Z 

27* 

3/3 

26 

30 

86. 7Z 

■>"> 

Ola  .? m 

02* 

3/4 

30 

4C 

75Z 

62. 5Z 

24* 

3/4 

29 

29 

100Z 

32 

90. 6Z 

28* 

3/4 

32 

32 

100Z 

33 

97Z 

87* 

3/5 

20 

20 

80Z 

25 

80Z 

29* 

3/5 

26 

29 

90Z 

32 

81. 2Z 

26* 

3/6 

25 

28 

86. 2Z 

30 

83.31 

01* 

3/12 

31 

31 

100Z 

32 

96. 9Z 

08* 

3/12 

29 

30 

96. 6Z 

31 

93. 5Z 

49 

3/17 

25 

31 

80. 6Z 

32 

78  11 

43 

3/1* 

2 

29 

82. 8Z 

31 

/7.4Z 

7 

3/18 

2o 

30 

86.71 

32 

81. 3Z 

25* 

3/18 

30 

30 

100Z 

32 

93. 8Z 

83 

3/19 

27 

29 

93.  IZ 

32 

84. 4Z 

3 

:i/2C 

14 

26 

53. 8Z 

29 

48. 3X 

37 

3/24 

8 

12 

66. 7Z 

14 

57.  IZ 

6P 

3/25 

6 

13 

46.  IZ 

13 

46.  IZ 

54 

3/25 

11 

2<» 

45. 8Z 

2J 

45.  8Z 

y. 

4/2 

17 

29 

58. 6Z 

32 

54. 8Z 

41 

4/8 

22 

31 

71Z 

32 

68. 8Z 

55 

4/9 

12 

24 

50Z 

30 

4CZ 

An  asterisk  (*)  denotes  a  school  that  undement  the  full  set  of  foliow- 
up  procedures. 
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A  more  accurate  indication  of  the  completion  rates  we  cou\d  expect 
to  achieve  in  the  bate  year  is  provided  in  the  next  subsection,  which 
specifically  considers  the  completion  rates  achieved  in  those  schools 
that  were  subject  to  full  follow-up. 

4.7.2  Summary  of  Final  Completion  Rates  for  Schools  Receiving  Pull 
Parent  Survey  Follow-Up 

Below  we  provide  summary  statistics  for  those  schools  in  which 
parent  cases  received  the  full  follow-up  treatment  as  necessary:  the 
thank-you/remiader  postcard,  the  prompt  telephone  call,  the  telephone 
interview  and  the  personal  interview.    The  schools  that  comprise  this 
subset  ot  the  Parent  Survey  sample  are  identified  by  an  asterisk  after 
the  School  NO&C  ID  number  in  the  table  on  the  previous  page. 

FORMULA  I:      PARENT  PARTICIPATION  RAT?  (base  =  all  parents  w.iose 

children  were  eligible  to  participate  in  the  Student  Survey) 

PULL  TREATMENT  SCHOOLS:    476/562  =  84. 7Z 

FORMULA  II:    PARENT  PARTICIPATION  RATE  (base  »  all  parents  whose 
children  partxcipated  in  the  Student  Survey) 

FULL  TREATMENT  SCHOOLS:  476/517  =    92. IX 

These  f.'*ures  offer  an  indication  of  what  we  might  expert  to 
achieve  in  che  base  year  when  time  will  be  sufficient  to  give  all 
schools  the  full  follow-up  treatment.    This  assumes  that  the  fie  id-test 
sample  proves  representative  of  the  base-year  sample. 

4.7.3  Summary  of  Final  Case  Tispositions  for  Non-Completions  in 
Schools  Receiving  Full  Parent  Follow-Up 

So  as  to  consider  methods  by  which  response  rates  can  be  raised  in 
the  base  year,  it  is  cf  interest  to  examine  the  final  dispositions  of 
those  cases  that  were  not  successfully  completed  in  the  field-test 
year.    The  cases  for  the  eighteen  schools  that  were  subject  to  full 
follow-up  treatment  are  again  employed  for  this  examination  as  a 
greater  amount  cf  effort  was  spent  on  these  cases  before  a  final 
disposition  was  assigned  than  was  expended  for  the  schools  with  the 
later  Survey  Days* 

Cases  outstanding  for  the  eighteen  schools  at  the  end  of  ihe 
field-test  included: 

(1)  12  reses  with  code  51  =  parent  refused  to  participate  in  survey 

(2)  9  cases  with  code  5?  =  parent  was  unlocatable 

(3)  6  cases  with  code  53  =  parent  was  unr  lilable 

(4)  3  cases  with  code  54  =  parent  hostilely  refused  to  participate 
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(5)  3  cases  with  code  5i  ■  parent  did  not  participate  because  of  a 

language  barrier 

(6)  20  cases  with  code  56  *  either  no  effort  was  made  to  pursue  the 

case  (11  cases)  or  parent  promised  to 
*vil  in  the  questionnaire  but  did  not  do 
so  (9  cases).    [Note:  the  unpursued  cases 
were  all  for  a  single  school,  that  which 
had  parent  residences  disr.  rsed  over  a 
forty-mile  radius.] 

In  addition,  the  following  final  statuses  were  registered  for  the 
cases  of  parents  of  children  who  were  eligible  to  be  surveyed  but  we  e 
not: 

(7)  20  cases  with  code  61  =  parent  refused  permission  for  cMld's 

participation  in  Student  Survey 

(8)  15  cases  with  code  81  =  child  absent  on  both  St  * vey  Day  and  Make  Up 

Day 

The  small  number  of  cases  that  could  net  be  completed  because  of  a 
language  barrier  is  particularly  interesting.    Interviewers  reported 
that  very  of'en  either  the  eighth-grader  or  another  relative  of  the 
parent  who  was  bilingual  helped  Uie  parent  complete  the  questionnaire. 

Given  that  21  out  of  <9  (42.9  percent)  of  the  non-completions  were 
explicit  refusals,  there  is  obviously  considerable  scope  for  improving 
refusal-conversion  efforts  in  the  base  year. 

As  noted  earlier,  the  nine  cases  in  which  the  parents  were 
unloca table  mainly  involved  migrant  workers  who  had  Jioved  without 
leaving  forwarding  addre«<es.    Thi*  category  represents  an  excellent 
example  of  the  situation  in  which  the  mail  treatment  fails  in  having 
the  questionnaire  reach  the  home  —  all  nine  cases  with  this 
designation  were  Central  Office  Mail  cases. 

The  35  cases  that  had  final  dispositions  of  either  61  or  81 
represent  a  segment  of  the  parent  sample  that  was  not  pursued  in 
follow-up  efforts  in  the  Tield  test  but  that  will  be  pursued  in  the 
base  year.    Special  approach  techniques  will  need  to  be  designed  to 
persuade  parents  whose  children  were  not  surveyed  in  the  base  year  to 
nevertheless  participate  in  the  Parent  Survey.    Since  gaining  t*>e 
cooperation  of  particularly  those  parents  who  have  denied  permission 
for  the  child's  survey  participation  will  be  extremely  challenging, 
every  possible  effort  should  be  made  to  minimize  denials  at  the  outset 
of  the  Student  Survey. 

4.7.4     Comparison  of  Parent  Participation  for  Various  Groupings 

Continuing  in  the  effort  to  identify  problem  respondents  that  may 
require  special  attention  in  the  base  year,  wj  now  examine  the  parent 
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participation  rates  according  to  the  following  classifications: 
Ethnicity,  School  Sector,  and  Permission  Type  Required. 


4.7.4.1  Ethnicity 

Here  there  any  strong  differences  in  participation  of  pare  its 
whose  children  were  identified  on  student  rosters  as  being  Hispanic, 
Asian-Pacific  Islander,  or  Core  (neither  Hispanic  nor  Asian-Pacific 
Islander)? 

Examination  of  the  parent  participation  rates  according  to 
ethnicity  is  important  for  at  least  two  reasons:  (1)  We  feared  that 
language  difficulties  might  result  in  low  participation  in  the  survey 
on  the  part  of  minority  group  members,  thus  biasing  the  sample  against 
recent  immigrants  and  others  of  special  policy  interest  in  need  of 
bilingual  education;  (2)  We  wanted  to  explore  the  implications  of 
having  only  an  English-language  version  of  the  Parent  Questionnaire  in 
the  base  year.    Ho  SpanUh- language  version  of  the  questionnaire  is 
budgeted.    (Had  we  found  the  Spanish  version  to  be  necessary,  we  could 
have  requested  technical  redirection  of  funds,  but  this  would  have 
meant  robbing  another  component  of  the  study.) 

The  results  listed  below  are  fairly  surprising.    Our  expectation 
was  that  the  response  ratis  for  the  non-Core  OBEMLA  groups  would  be 
well  below  those  for  the  Core  segment.    Clearly  they  are  not.    One  must 
be  cautious,  however,  in  not  overgeneralizing  on  the  basis  of  these 
results.    Sixty-three  of  the  Hispanic  students  in  the  survey  were 
attending  two  exclusively  Hispanic  private  schools  in  Miami,  Florida. 
The  school  personnel  in  both  schools  were  extremely  supportive  of  the 
study.    It  is  possible  that  the  mostly  Cuban  population  that  chese 
schools  represent  possess  characteristics  not  strictly  generalizable  to 
other  Hispanic  subgroups. 


COMPARISON  OP  PARENT  PARTICIPATION  RATES  ACCORDING  TO  OBEMLA  STATUS 
A.  FORMULA  I  Calculation: 


TABLE  4-5 


Questionnaires 
Received 


Eligible 


Students 


Percentage  of 
Parent  Participation 


HISPANIC: 


152 


186 


81.  n 


ASIAN  /  PACIFIC 
ISLANDER: 


61 


79 


77. 2Z 


CORE: 


562 


735 


76. 51 
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T\BLE  4-5  (continued) 


B.  FORMULA  II  i^lculation: 


Questionnaires 
Received 


Students 
Surveyed 


Percentage  of 
Parent  Participation 


HISPANIC: 


151 


168 


90Z 


ASIAN  /  PACIFIC 
ISLANDER: 


72 


84. 7Z 


CORE: 


553 


684 


80. 1Z 


These  results  do  not  lend  strong  support  to  the  idea  that  a 
Spanish- language  edition  of  the  Parent  Questionnaire  light  be  necessary 
in  the  base  year.    Nevertheless,  we  might  consider  pr£paring  so^e 
contacting  materials  in  Spanish  and  the  desirability  of  providing  a 
Spanish-language  questionnaire  should  not  be  dismissed  without  more 
thorough  examination.    We  should  a) so  devise  some  method  for  aiding  the 
participation  of  the  Asian/Pacific  Islander  segment  of  our  NELS:88 
sample.    We  might,  for  example,  ask  School  Coordinators  in  those 
schools  thae  * *ve  a  large  population  of  Asian/Pacific  Islanders  to 
identify  people  in  the  commit  ity  who  speak  the  various  n  levant 
languages  and  might  be  willing  to  help  our  parent  respondents  complete 
their  questionnaires. 

4. 7*4.2      School  Sector 

Were  there  any  strong  dif Terences  among  participation  rates  of 
parents  whose  children  were  attending  Catholic,  Other  Private,  or 
Public  schools? 

Examination,  of  the  response  rates  for  parents  of  children  in  the 
various  school  sectors  is  extremely  important  since  school  sector  is  a 
major  analytic  variable  and  we  do  not  want  to  encounter  sample  bias. 
Miis  is  particularly  the  case  since  we  have  oversampled  the  private 
scnools  to  support  comparisons  of  public  and  private  schools. 

As  one  can  see  from  the  results  below,  there  is  a  wide  variation  in 
the  response  rates  of  the  three  sectors. 
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TABLE  4-6 

COMPARISON  OP  PARENT  PARTICIPATION  ACCORDING  TO  SCHOOL  SECTOR 


A.  PORHULA  I  Calculation: 


Questionnaire? 
Received 

Students 
Eligible 

Percentage  of 
Parent  Participatio 

CATHOLIC: 

157 

174 

90.22 

OTHER  PRIVATE: 

95 

152 

62. 5Z 

PUBLIC: 

522 

673 

77. 6Z 

B.  FORMULA  II 

Calculation: 

Questionnaires 
Received 

Students 
Surveyed 

Percentage  of 
Parent  Participation 

CATHOLIC: 

156 

170 

91. 8Z 

OTHER  PRIVATE: 

94 

139 

67. 6Z 

PUBLIC: 

514 

615 

83.62 

It  certainly  seems  clear  that  we  need  to  give  special  attention  to 
gaining  cooperation  from  both  students  and  parents  in  the  Other  Trivate 
schools.    The  ertremely  hi> h  participation  rates  of  the  Catholic 
parents  *re  very  gratifying.    We  will  certainly  wish  to  draw  attention 
to  these  response  rates  when  attempting  to  bring  Catholic  schools  into 
the  MELS.88  base-year  sample. 

4.7.4.3     Type  of  Permission 

Were  there  any  strong  differences  in  participation  of  parents  whose 
children  attended  schools  that  required  explicit  and  implied  consent? 

Throughout  the  NELS.88  Field  Test,  we  encountered  considerable 
difficulties  with  schools  using  an  explicit  form  of  parental  consent. 
Although  no  easy  answer  is  available,  an  interesting  question  is 
whether  a  school  which  chooses  to  use  explicit  consent,  while  only 
trying  to  protect  the  rights  of  parents,  iis  implicitly  sending  to  the 
parents  the  message  that  there  is  something  to  be  feared  in  giving 
cooperation.    In  any  case,  the  results  listed  below  offer  support  for 
our  general  argument  that  vse  of  explicit  consent    lould  be  avoided 
whenever  possible. 
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TABLE  4-7 

COMPARISON  OP  PARENT  PARTICIPATION  ACCORDING  TO 
PARENTAL  PERMISSION  TYPE 

A.  FORMULA  I  Calculation: 

Questionnaires       Students       Percentage  of 
Received  Eligible       Parenc  Participation 

EXPLICIT  CONSENT:      208  295  70. 8Z 

IMPLIED  CONSENT:        522  644  81. 1Z 


B.  FORMULA  II  Calculation: 

Questionnaires 
Received 

EXPLICIT  CONSENT:  208 
IMPLIED  CONSENT;  5'2 


Students  Percentage  of 

Srrveyed  Parent  Participation 

265  78. 5Z 

600  85.31 


If,  however,  one  omits  from  consideration  the  New  York  City  public 
schools,  all  of  which  were  required  by  the  New  York  City  Board  of 
Education  co  use  explicit  consent,  then  the  two  <2CPLICIT  *nd  IMPLIED 
response  rates  move  closer  together: 

C.  FORMULA  I  Calculation: 

EXPLICIT  CONSENT*  171/206  =  83% 

D.  FORMULA  II  Calculation? 

EXPLICIT  CONSENT:  171/188  ~  91Z 

It  should  be  noted  that  in  most  of  the  other  schools  where 
explicit  consent  was  employed,  the  School  Coordinators  (and  the  Central 
Office  Staff)  put  a  great  deal  of  effort  into  bcch  trirzking  parental 
permission  and  encouraging  the  eighth-graders  to  participate  in  the 
Student  Survey.    Too,  most  of  the  parent  cases  for  these  other  schools 
were  subject  to  the  full  range  of  follow-up  treatment. 
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4. 7 .5      Recommendations  for  the  Base  Year 

The  ttatittict  cited  abo*e  reveal  many  areas  where  improvements  c*n 
be  pursued  in  the  base  year.    It  seems  particularly  essential  that  we 
conduct  preparatory  research  on  two  subjects:  (1)  discovering  potential 
sou  ces    1  support  within  the  various  types  ot  Other  Private  schools, 
that  is,  identifying  groups  or  individuals  who  might  aid  us  in 
encouraging  parent  involvement  with  NELS:88;    and  (2)  persuading 
officials  of  all  schools— but  parc'culaKy  the  New  York  City  Board  of 
Education — that  explicit  consent  unnecessary  burden  that  results 

in  weak  participation  rates  that  seriously  hamper  scientific  research. 
Further  attention  will  be  given  to  the  second  of  these  goals  in  the 
next  section  of  this  chapter  which  summarizes  the  problems  we  had  in 
conducting  the  Parent  S  irvey  in  New  York  City  Public  School. 

4.8     New  York  City:    A  Special  Case 

The  Parent  Survey  follow-up  in  New  York  City  "as  extremely 
challenging.    This  section  details  the  difficulties  encountered. 


4.8.1  Summary  of  Restrictions  Placed  on  the  NELS:88  Parent  Survey 
in  New  York  City 

As  was  noted  in' Chapter  One  of  this  report,  the  New  York  City 
Board  of  Education  placed  sever.,  restrictions  cn  the  Parent  Survey  of 
NELS:88.    They  required  that  the  letter  thar  accompanied  the  Parent 
Questionnaire  be  rewritten  to  explain  specifically  why  the  income  and 
locator  information  was  being  requested.    Additionally,  NORC  was  not 
permitted  to  seek  telephone  contact  with  the  parents  for  the  purpose  of 
prompting  return  of  questionnaires.    No  telephone  personal 
interviewing  was  allowed  unless  specifically  requested  by  the  parents 
themselves.    NORC  was  permitted  to  provide  a  name  and  number  that  could 
be  called  should  the  respondent  desire  either  of  these  two  forms  of 
questionnaire  administratis.    Later  it  was  agreed  that  if  a  parent  had 
provided  a  telephone  number  in  the  locator  section  of  the  Parent 
Questionnaire,  then  NORC  would  be  ptnnitted  ro  call  the  household  to 
attempt  to  retrieve  missing  critical  i^sm  information.    Permission  was 
also  granted  to  send  any  reasonable  written  follow-up.    The  New  York 
City  Board  of  Education  made  available  to  NORC  newly-updated  parent 
address  rosters. 

4.8.2  Procedures  Followed  in  Conducting  the  Parent  Survey  in  New 
York  City  Public  Schools 

Three  New  York  City  public  schools  were  included  in  che  NELS:88 
Parent  Survey  sample.    Of  these,  two  were  designated  for  the  Central 
Office  Mail  treatment  and  one  was  designated  for  the  Student  Tak^  Home 
treatment.    Questionnaires  were  distributed  to  parents  of  students  of 
the  New  York  City  public  schools  identically  to  distribution  in  the 
ochor  schools*    The  r.hank-you/ reminder  postcard  was  also  mailed 
according  to  the  usual  schedule. 
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When  initial  returns  of  Parent  Questionnaires  proved  to  be 
extraordinarily  weak  (see  Section  4.8.3) ,  a  careful  comparison  was  made 
of  the  addresses  the  School  Board  had  provided  with  those  the  sampled 
students  had  provided  in  the  locator  pages  of  the  Student 
Questionnaire.    Many  discrepancies,  several  of  them  substantial,  were 
found •    Spec  i  f  i c  al ly : 

Of  the  77  cases  that  the  Parent  Survey  encompassed,  comparing 
addresses  provided  by  the  Board  of  Education  and  the  student  locator 
pages  of  the  Student  Survey: 

-  14  addresses  were  completely  different 

-  17  addresses  were  identical  as  to  street  address  but  differed 
ror  city  name  (examples:  Queens,  N.Y.  and  Jamaica,  N.Y.;  South 
Ozone  Park,  N.Y.  and  Jamaica,  N.Y.;  New  York  City,  N.Y.  and 
Jamaica,  N.Y.) 

-  3  had  unlike  sip  codes 

-  13  had  apartment  numbers  provided  in  the  locator  information  but 
not  in  the  school  information 

-  1  differed  in  zip  code  AND  the  mother's  last  name  differed  from 
that  of  the  child's    [Recall  that  questionnaires  were  addressed: 
(TO  THE  PARENTS  OP:  name  of  child) 

-  8  showed  a  mother's  last  name  that  differed  from  that  of  the 
child,  even  though  the  address  given  was  essentially  correct 

On  the  basij  of  these  findings,  about  two  weeks  after  the  last 
Survey  Day  was  held  in  these  schools,  remailings  were  done  to  all 
Outstanding  cases  together  with  a  follow-up  letter  that  was  designed  to 
substitute  for  the  prompting  telephone  call.    Addresses  used  for  that 
mailing  were  those  provided  by  the  students  themselves,  w  enever  such 
addresses  and  the  original  labels  disagreed. 

While  one  cannot  know  for  certain  which  of  two  discrepant  addresses 
was  the  correct  one,  of  approximately  twenty  New  York  City  Public 
School  cases  that  have  come  in  since  the  second  mailing  the  addresses 
provided  by  the  parents  in  the  Parent  Questionnaire  locator  pages  are 
exactly  the  same  as  those  provided  by  their  children  in  the  Student 
Questionnaire  locator  pages  in  ell  cases. 

4.8.3         Presentation  of  Response  Rates  in  th*  New  York  City  Public 
Schools 

Using  the  "student  surveyed"  base,  that  Is,  Formula  II,  tY * 
following  are  the  response  rates  that  obtained  at  the  time  the  second 
mailing  was  done  in  the  New  York  School,: 
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School  54  (four  weeks  after  Survey  Day):  7/24  *  29% 
School  55  (two  weeks  after  Survey  Day)^  6/24  *  252 
School  56  (three  weeks  after  Survey  Day):  11/29  3  37. 9Z 

On  the  fine!  day  tiat  questionnaires  were  sent  to  data  processing 
(two  weeks  following  calculation  of  the  figures  given  above),  the 
response  ratts  were  as  follows: 

School  54  (six  weeks  after  Survey  Day):  11/23  *  47. 8Z 
School  55  (four  weeks  after  Survey  Day)i  10/24  -  41. 6Z 
School  56  (five  weeks  after  Survey  Day):  16/28  =  ^7.1% 

Using  the  "student  eligible"  base,  (Formula  I),  these  are  the 
response  rates  that  obtained  at  the  time  the  second  mailing  was  done: 

School  54  (four  weeks  after  Survey  Day):  7/28  -  25Z 
School  55  (two  weeks  after  Survey  Day):  6/30  -  20Z 
School  56  (three  weeks  after  Survey  Day):  11/31  -  35. 5Z 

TWo  weeks  later,  these  were  the  .rates: 

School  54  (six  weeks  after  Survey  Day):  11/28  -  39.32 
School  55  (four  weeks  ^  :ter  Survey  Day):  10/30  -  33. 3Z 
School  56  (five  weeks  after  Survey  Day):  16/31  =  51. 6Z 

4.8.4         Recommendations  for  the  Base  Year  Concerning  New  York  City 
Public  Schools 

Every  effort  should  be  made  to  convince  the  New  York  City 
authorities  to  ease  the  restrictions  now  placed  on  the  Parent  Survey 
Follow-Up.    In  addition  to  the  poor  response  rates  documented  above, 
the  problem  also  exists  that  the  New  York  City  parents  more  often  than 
usual  omitted  telephone  numbers  when  filling  in  locator  infotmation, 
reducing  the  amount  of  retrieval  that  could  be  done.    As  can  be  seen 
elsewhere  in  this  report,  parents  often  were  quite  agreeable  to 
changing  their  minds  about  answering  some  of  the  more  sensitive 
cri    cal  items  after  they  had  had  an  opportunity  to  be  reassured  about 
confidentiality  by  a  representative  of  NORC.    It  is  doubtful  that 
written  communication  can  ever  oe  as  effective  in  this  regard. 

Even  if  we  are  successful  in  convincing  New  York  City  to  let  us 
have  telephone  contact  with  the  parents,  it  is  still  critical  that 
something  be  done  to  assure  that  we  have  highly  improved  addresses, 
particularly  if  a  mail  treatment  is  indicated.    An  argument  for 
.regularly  having  an  Orientation  Day  approximately  a  week  prior  to 
Survey  Day  is  thau  one  could  have  students—who  should  already  have 
parental  permission  granted  by  this  time — provide  up-to-date  addresses 
prior  to  Survey  Day. 

In  general,  every  effort  should  be  made  to  allay  any  suspicions  the 
New  York  City  parents  might  have  about  the  legitimacy  of  NELS:88. 
Possibly  a  letter  originating  from  either  the  U.S.  Department  of 
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Education  or  the  New  York  Department  of  Education  might  be  included  in 
the  original  Parent  Packet. 

4.9  Conclusion 

The  data  collection  segment  of  the  NELS:88  Parent  Survey  Field  Test 
met  two  critical  goals:    With  only  a  very  short  time  period  in  which  to 
conduct  follow-up  on  outstanding  questionnaires,  high  completion  rates 
were  achieved.    Moreover,  much  valuable  information  was  gathered  to 
inform  the  design  of  data  collection  for  the  base  year. 

Perhaps  the  most  interesting  result  that  emerged  from  the  field 
test  of  the  NELS:88  Parent  Study  was  the  effectiveness  of  having 
children  carry  questionnaires  home  to  their  parents.    While  many 
schools  refused  to  provide  parent  address  information  necessary  for 
NORC  mailing,  none  of  the  schools  expressec  any  dissatisfaction  with 
allowing  the  eighth-graders  to  deliver  patent  questionnaires.    In  the 
base  year,  we  will  certainly  need  to  maintain  flexibility  in  response 
to  schools1  desires  concerning  parent  questionnaire  delivery.  The 
STUDENT  TAKE  HOME,  CENTRAL  OFk'ICE  MAIL  and  SCHOOL  MAIL  treatments  could 
all  be  successfully  employed  to  obtain  hi^h  response  rates,  as  our 
experience  in  the  field  test  h.is  amply  demonstrated.    However,  the 
STUDENT  TAKE  HOME  method  would  seeir  particularly  promising,  as  the 
principal  method  of  parent  questionnaire  dei;.*ery  for  the  base  year. 

While  overa1!  the  rate  of  participation  in  the  Parent  Survey  was 
high,  for  some  specific  groups  the  extent  of  participation  was 
relatively  low.    Parents  of  children  who  attend  non-Catholic  private 
schools  and  parents  of  children  who  attend  New  v-rk  City  Public  Schools 
in  particular  appear  to  require  special  attention  in  the  base  year.  On 
the  other  hand,  if  our  results  concerning  Catholic-school  parents  end 
Hispanic-origin  parents  are  generalizable,  a  considerable  amount  of 
extra  attention  may  not  need  to  be  given  to  persuading  members  of  these 
groups  to  participate  in  the  NELS:88  Parent  Survey.      A  more  ambiguous 
result  emerged  for  the  participation  rates  of  parents  whose  children 
attended  schools  that  required  an  explicit  form  of  parental  permission 
for  the  child's  participation  in  the  Student  Survey.    When  the  New  York 
City  Public  Schools  were  removed  from  consideration,  the  j  -ent 
participation  rates  (figured  either  by  Formula  I  or  by  Formula  II)  for 
the  remaining  explicit-consent  schools  differed  little  from  those 
achieved  in  the  schools  using  implied  consent.    However,  as  was  pointed 
out  in  the  original  discussion,  a  great  deal  of  time  and  expense  were 
spent  in  raising  both  student  and  parent  participation  rates  in  the 
explicit-consent  schools.    Clearly,  use  of  explicit  consent  should  be 
avoided  whenever  possible  in  the  base  ye.*r. 

An  especially  gratifying  finding  of  our  field  test  was  how  willing 
the  parents  of  our  sampled  eighth-graders  were  to  contribute  to  our 
study.    A  surprisingly  large  number  of  parents  mailed  in  their 
questionnaires  without  being  prompted  at  all.    When  interviewers  did 
have  occasion  to  contact  parents,  either  for  retrieving  or  prompting, 
they  usually  found  the  parents  to  be  friendly  and  cooperative.    Of f - 
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parents  used  the  opportunity  of  the  telephone  contact  to  convey 
compliments  on  NELS:88.    The  clear  impression  that  we  received  was  that 
the  parents  of  eighth-graders  care  deeply  about  the  quality  of  their 
children's  educations  and  are  most  gratefvl  that  the  federal  •  jvernment 
ia  sponsoring  research  that  may  help  to  enhance  that  qualify. 


CHAPTER  4B 

PARENT  QUESTIONNAIRE  ANALYSIS 


4.10    Introduction  to  the  Parent  Questionnaire  Analysis 

Prom  the  perspective  of  the  Parent  Questionnaire  the  purposes  of 
the  Field  Test  have  been 

•    to  compare  different  methods  of  distributing 
the  questionnaire  with  resp^zt  to 

-  overall  response  rate  and 

-  the  response  rates  for  critical  items 


•  to  examine  the  responses  to  individual  items 
in  order  to 

-  identify  ambiguities  or  aifficulties  in 
wording  or  format 

~  collapse  response  categories  and  refine  items 

•  to  compare  parent  and  student  responses  on  similar 
items 


This  report  is  organized  roughly  around  these  three  purposes. 
Section  4.11  examines  the  returns  realized  from  the  three  different 
methods  of  distributing  the  questionnaires.    Section  4.12  examines  the 
response  rates  to  individual  items,  starting  with  the  critical  items 
^nd  then  considering  the  remaining  items.    Section  4.13  compares  the 
responses  of  students  and  parents  on  similar  items. 

First  a  word  should  be  said  about  the  length  of  the  questionnaire 
and,  by  implication,  respondent  burden.    Questionnaire  respondents  were 
not  asked  how  much  time  they  spent  completing  the  questionnaires. 
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This  was  an  oversight.    A  pilot-test  of  the  instrument  prior  to  the 
field  test,  however,  yielded  estimates  by  respondents  of  between  20  and 
40  minutes  as  the  time  it  took  them  to  complete  the  questionnaire 
(self-administered)  and  comment  on  the  question*  themselves.  Timing 
information  was  obtained  from  the  36  individuals  to  whom  the 
questionnaire  was  administered  in  its  entirety  on  the  telephone. 
(Telephone  interviews  typically  take  longer  than  self-administered 
questionnaires.)    The  average  interview  lasted  44  minutes,  suggesting 
that  the  self-administered  version  may  not  need  to  be  reduced  by  much. 

The  field  test  version  of  the  questionnaire  was  intended  to  be 
about  20  percent  longer  than  the  target  instrument,  which,  in  turn,  was 
intended  to  take  30  minutes  to  complete.    The  goal,  then,  is  to  reduce 
the  length  of  the  Parent  Questionnaire  by  20  percent  at  the  most. 

For  the  base  year  survey,  a  separate  version  of  the  parent 
questionnaire  may  be  desirable  for  use  by  telephone  interviewers. 

4.11    Parent  Response  by  Distribution  Method 

Parent  Questionnaires  were  distributed  in  three  different  ways. 
Just  ufider  400  (398)  of  the  instruments  were  mailed  directly  to  parents 
in  advance  of  Survey  Day.    An  additional  number  057)  were  mailed  by 
the  school,  not  a  planned  strategy  but  one  that  was  adopted  when  five 
schools  refused  to  provide  NORC  with  names  and  addrr?ses  of  parents. 
The  largest  number  (427)  were  given  to  students  to  give  to  their 
parents.    The  purpose  of  this  exercise  was  to  assess  the  effect  of 
different  means  of  getting  questionnaires  into  the  hands  of  the 
appropriate  respondents  on  the  rate  of  response.    (NOTE:    These  figures 
differ  slightly  from  those  presented  in  Part  A  since  determination  of 
the  parent  sample  differs  in  the  two  analyses.    In  the  present 
analysis,  all  parents  of  eligible  students  who  were  mailed  the 
questionnaire,  either  by  NORC  or  the  school,  are  considered  a  part  of 
the  sample.    For  the  situation  in  which  the  child  was  to  deliver  the 
questionnaire,  only  parents  whose  children  were  actually  surveyed  are 
counted  as  being  in  the  sample.) 

By  approximately  twelve  weeks  after  the  first  Survey  Days  took 
place,  609  questionnaires  had  been  data  processed  at  NORC.    Some  of  the 
schools  had  had  their  Survey  Days  only  a  few  weeks  before.    Of  the  609 
cases,  177  were  from  the  group  mailed  by  NORC,  136  were  from  among 
those  mailed  by  the  schools,  and  the  remaining  296  were  from  those 
taken  home  by  the  students.    An  additional  119  questionnaires  were 
received  after  the  six-week  mark.    Because  no  efforts  were  made  at 
retrieval  of  the  later  questionnaires,  it  is  probably  most  useful  to 
examine  the  returns,  especially  for  critical  items,  in  the  light  of  the 
609  cases.    Table  4-8  summarizes  the  information  for  both  the  609  cases 
and  the  total  of  775  that  will  ultimately  represent  the  full  dataset 
for  the  parent  questionnaire. 
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TABLE  4-8 

OVERALL  RESPONSE  RATE  BY  DISTRIBUTION  METHOD 


1 

V 

METHOD 

ELIGIBLE 

RETRIEVAL 
ATTEMPTED 
SAMPLE 
(n=609) 
n  Z 

ENTIRE 
SAMPLE 
(n=775) 

n  Z 

NORC  MAILED 

398 

177 

44.5 

269 

67.6 

SCHOOL  MAILED 

157 

136 

86.6 

150 

95.5 

STUDENT  DELIVERED 

427 
982 

296 
609 

69.3 
62.0 

366 
775 

85.7 
73.9 

(MOTE:  These  figures  differ  slightly  from  those  presented  in  Part  A 
since,  for  technical  reasons,  the  NORC  author  reclassified  a  small 
number  of  cases.    Nevertheless,  the  conclusions  reached  by  the  NORC 
author  and  the  ETS  author  are  essentially  identical.) 

Based  on  the  609  cases,  and  based  solely  on  the  numbers  of 
questionnaires  available  for  analysis,  there  appear  to  be  substantial 
differences  in  the  response  rates  achieved  using  e  ich  method. 
Questionnaires  mailed  by  the  school  fared  best,  having  been  returned  in 
87  percent  of  the  cases.    While  this  response  rate  is  impressive,  it 
should  be  treated  cautiously,  since  r.here  were  only  five  schools  that 
employed  this  treatment  and  the  five  were,  in  one  sense,  self-selected. 
Student  delivery  produced  a  70  percent  response  rate.  The 
questionnaires  mailed  by  NORC  were  returned  in  less  than  half  of  the 
cases,  44  percent. 

These  results  suggest  that  parents  may  be  less  likely  to  pay 
attention  to  a  mailing  from  an  unknown  survey  organization  than  they 
are  to  something  sent  by  their  child's  school,  either  through  the  mail 
rr  delivered  by  their  children.    At  the  same  time,  the  school-mailed 
questionnaires  were  not  distinguishable  from  the  NORC-mailed 
instruments  in  any  obvious  way.    It  is  difficult  to  know  whether  the 
higher  response  rate  for  questionnaires  mailed  by  the  school  compared 
with  those  delivered  by  students  is  due  primarily  to  parents1 
interpreting  as  more  serious  anything  that  is  mailed  them  by  the 
school,  or  to  students1  failurr  to  deliver  the  questionnaire  in  all 
cases.    The  results  do  suggest  that  distribution  through  the  school  may 
be  preferable  to  direct  mailing  to  parents  by  NORC.    While  mailing 
directly  to  parents  by  the  scnool  apoears  to  be  preferable  io  sending 
the  questionnaires  home  with  students,  the  method  did  not  receive  a 
fair  test  since  the  schools  that  used  it  were  self-selected.  Having 
the  school  mail  the  questionnaires  or  having  the  students  deliver  them 
does  eliminate  the  often  difficult  chore  of  convincing  schools  to 
provide  parents1  addresses,    (it  is  not  clear,  however,  that  all 
schools  would  be  willing  to  mail  the  questionnaires.    The  school  is 
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asked  to  prepare  address  labels,  a  task  which  the  School  Coordinator 
might  view  as  excessively  burdensome.)    Finally,  the  returns  clearly 
demonstrate  that  having  students  take  the  questionnaires  home  is  a 
viable  method  of  delivery,  on*  that  does  not  jeopardize  the  response 
rate  in  any  significant  fashion. 

In  almost  all  cases  of  returned  questionnaires,  the  questionnaire 
was  delivered  to  and  completed  by  the  appropriate  person.    According  to 
the  responses  to  Question  l.B,  in  only  two  cases  did  the  respondent 
indicate  that  the  child  lives  with  him  or  her  less  than  half  of  the 
time.    The  vast  majority  of  the  respondents  are  parents:    75.1  percent 
of  the  questionnaires  were  completed  by  the  child's  mother  and  13.7 
percent  by  the  child's  father. 

Pew  of  the  critical  items  seem  to  have  been  affected  by 
distribution  method.    That  is,  examining  post-retrieval  response  rates 
for  critical  items  by  distribution  method,  there  are  sore  but  not  many 
substantial  differences.    Most  of  the  items  that  differ  by  distribution 
method  favor  the  school  as  agent  of  distribution.    These  differences 
are  discussed  below,  in  the  context  of  a  detailed  examination  of  the 
critical  items. 


4.12      Response  Rates  To  Individual  Items 


4.12.1    Critical  Items 

Part  One  of  the  Parent  Questionnaire  is  the  longest  section  and 
accounts  fot  about  half  of  the  questions  asked  in  the  field  test  form 
of  the  instrument.    This  section  is  mainly  about  the  family  background 
of  the  student.    Many  of  the  questions  were  used  in  US&B. 

Critical  items  in  this  section  ask  about  the  relationship  of  the 
respondent  to  the  studen.  (Q.1.1A),  and  for  how  much  of  the  time  the 
student  lives  with  the  respondent(Q. 1.1B);  for  the  ethnic  origin  (Q. 
1.9)  and  race  (Q.1.10)  of  the  respondent;  whether  the  respondent  speaks 
a  language  other  than  English  (Q.1.22),  and  how  well  the  respondent 
understands,  speaks,  reads,  and  writes  a  non-English  language  (Q.1.24) 
and  English  (Q.1.25);  what  language  is  usually  spoken  in  the 
respondent's  home  (Q.1.26);  what  language  is  spoken  to  the  child  (Q. 

1.27)  and  what  language  the  child  speaks  to  the  respondent  at  home  (Q. 

1.28)  ;  the  highest  level  of  education  completed  by  the  respondent  (Q. 
1.32);  the  employment  status  of  the  respondent  (Q.1.34)  and  the  kind  of 
work  (s)he  does  (Q.1.35);  the  number  of  tin  a  '.he  child  has  changed 
school  since  (s)he  entered  first  grade  (Q. 1. 39);  and  locating 
information  in  the  form  of  the  names,  addresses,  and  telephone  numbers 
of  the  respondent  (Q.1.41),  a  close  relative  (Q.1.42),  a  close  family 
friend  (Q.1.43),  and  the  high  schjol  the  child  is  expected  to  attend 


(Q.1.44). 
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Part  Two  contains  only  four  questions,  asking  about  the  parent's 
aspirations  for  the  child,  the  parent's  assessment  of  influences  on  the 
child's  choices  about  education,  and  whether  the  parent  perceives  the 
child  to  have  any  handicapping  conditions.    Critical  items  in  this 
section  are  the  questions  about  aspirations  (Q.2.1)  and  handicapping 
conditions  (Q.2.4). 

Part  Three  is  about  the  child's  school  history  an    current  school 
experience.    Critical  items  in  this  section  ask  whether  the  child  has 
ever  received  special  services  for  a  variety  of  handicapping  conditions 
(Q.3.2),  whether  the  child  is  considered  to  have  a  behavior  problem  in 
school  (Q.3.3),  and  whether  the  child  is  enrolled  in  special  language 
programs  (Q.3.12A  and  3.12B),  in  special  services  for  the 
orthopec  ically  handicapped  (Q.3.12C),  or  in  special  education  services 
for  slow  learners  (Q.3.12D). 

Part  Pour  of  the  Questionnaire  has  to  do  with  the  child's  life  at 
home  specifically  as  it  may  relate  to  school  behavior  and  performance* 
Critical  items  in  this  section  include  questions  about  who  is  at  home 
when  the  child  returns  from  school  (Q.4.12)  and  the  amount  of  time  the 
child  is  without  adult  supervision  during  the  day  (Q.4.I3). 

*  Parts  Five  and  Six  are  about  the  parents'  contacts  with  the  child's 
school  and  their  attitudes  toward  the  school.    These  sections  contain 
no  critical  items. 

Part  Seven  asks  questions  about  the  family's  financial  status  and 
the  extent  of  their  planning  for  the  child's  future  education. 
Critical  items  in  this  section  include  questions  about  family  income 
(s,.7.1)  and  whether,  in  what  form,  and  how  much  money  has  been  set 
aside  for  the  child's  postsecondary  education  (Q.7.6). 

Table  4-5  shows  the  percentage  of  invalid  responses  for  each  of  the 
critical  items  in  the  Parent  Questionnaire.    Invalid  responses  include 
missing  data  (blanks),  refusals,  multiple  responses  (to  single-response 
questions),  and  respondent  indicated  Don't  Knows. 

TABLE  4-9 

PERCENT  INVALID  RESPONSE  FOR  ALL  CRITICAL  ITEMS* 


Item  #                                  Content                               Percent  Invalid 

1.1A  R's  relationship  to  student  2.7 

1.1b  Amount  of  time  child  lives  with  respondent  0.2 

1*9  R's  origin  or  descent  3.8 

1.10  R's  race  0.4 

1.22  Does  R  speak  a  non-English  language?  C,4 

1.24A  R's  ability  to  understand  a  non-English  language  59.9 

1.24B  R's  ability  to  speak  a  non-Ziglish  language  61.3 

1.24C  R's  ability  to  read  a  non-English  language  60.7 

1.24D  R's  ability  to  write  a  non-English  language  6C47 

1.25A  R's  ability  to  understand  English  55.4 
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Item  # 


Content 


Percent  Invalid 


1.2!>B  R's  ability  to  speak  English  55.7 

1.25C  R's  ability  to  read  English  55.7 

1.25D  R's  ability  to  write  English  55.7 

1.26  Language  spoken  at  home  56.3 

1.27  Language  spoken  to  child  at  home  54.3 
1*28  Language  child  speaks  at  home  54.3 
1.32  Highest  level  of  education  completed  by  R  12.5 
1.34  R's  employment  statu*  in  last  week  0.6 
1.34A  R's  activity  last  week  (if  "nr"  to  1.34)  75.0 
1.34B  Has  R  ever  held  a  regular  job  (if  "no"  to  1.34)  73.4 
1.35B  Type  of  work  R  normally  does  ** 
1.39  School  changes  for  child  since  first  grade  1.2 

1.41  R's  name,  address  and  telephone  number  ***-i 

1.42  Relative's  name,  address  and  telephone  number  ***-2 

1.43  Family  friend's  name,  address  ar.d  telephone  number  ***-3 

1.44  Where  child  is  expected  to  go  to  high  school  ***-4 


2.1 

How  far  R  expects  child  t;o  go  in  school 

8.2 

2.4 

Handicapping  conditions: 

2.4A 

-  Visual  handicap 

3.t 

2.4B 

-  Hearing  problem 

3.9 

2.4C 

-  Deafness 

4.2 

2.4D 

-  Speech  problem 

3.9 

2.4E 

-  Orthopedic  problem 

4.2 

2.4P 

-  Specific  learning  problem 

2.8 

2.4C 

-  Other  health  problem 

7.5 

3.2  Child  received  special  services  for: 

3.2A  -  Visual  handicap  3.6 

3.2B  -  Hearing  problem  3.8 

3.2C  -  Speech  problem  4.0 

3. 2D  -  Deafness  2.5 

3.2E  -  Orthopedic  problem  4.2 

3.2P  -  Specific  learning  problem  3.2 

3.2G  -  Other  health  problem  8.4 

3.3  Is  child  a  behaviour  problem  at  school?  0.6 
3.12  Is  child  enrolled  in  special  services? 

3.12A  -  Bilingual  program  2.1 

3-12B  -  English  as  a  second  language  program  4.1 

3.12C  -  Services  for  orthopedically  handicapped  3.8 

3.12D  -  Special  education  services  for  slow  learners  3.8 
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Item  # 

Cont en t 

i nvfli in 

D  A  0      #t  m%  *y  a 

Response 

4.12 

Who  if  home  when  child  returns 

frfsm  a  rhnn  1  7 

X.  L  VIII    9  WllwU  L  • 

4.12A 

—  Both  parent t 

1  A  1 

4.12B 

-  Respondent 

-  Rft  spouse 

4.12C 

18.0 

4.12D 

"  Other  adult  relative 

17.4 

4.12B 

-  Sitter 

19.7 

4.12P 

-  Adult  neighbor 

19.7 

4.12G 

-  Older  sibling 

16,3 

4.12U 

-  Younger  sibling 

18.2 

4.121 

-  No  one 

22.8 

4.13 

Time  child  spends  unsupervised 

1.0 

7.1 

Pamily  income 

7.1A 

-  Pi  <x»  wages 

7.1 

7.  IB 

-  Proa  own  business 

17.3 

7.6 

Is  family  saving  money  for  child's  education 

3.3 

7.6A 

If  "yes"  to  7.6,  how? 

•  6AA 

-  Savings  account 

61.8 

.6AB 

-  Insurance  policy 

65.9 

.6AC 

-  Savings  bonds 

68.3 

.6  AD 

-  Investments' 

67.3 

.  6AE 

-  Trust  fund 

70.2 

.6AP 

-  Additional  job 

69.4 

.6AG 

-  Something  else 

80.7 

.6B 

-  Amount  set  aside  for  child's  education 

50.9 

.6C 

-  How  much  when  child  finished  high  school? 

53.2 

♦Includes  blanks,  refused,  multipi  »  responses,  and  Don't  Knows 
♦♦Opened  responses,  treated  elsewhere 

♦♦♦Different  response  rates  for  different  datL  elements,  see  text. 


The  remainder  of  this  section  describes  the  critical  items  -nth 
invalid  responses  amounting  to  five  percent  or  more  of  the  eligible 
respondents.    Although  five  percent  is  a  low  threshold,  it  was  chosen 
to  provide  the  most  stringent  evaluation  of  the  critical  items. 
Possible  reasons  for  the  response  rate  are  presented  along  with 
recommendations  for  revisions  to  the  items. 

Questionnaire  Respondents 

Questions  1.1A  and  1.1B;  identical  in  form  and  substance  to 
questions  used  in  HS&B,  ask  for  the  relationship  of  the  respondent  to 
the  student  and  whether  and  for  how  much  of  the  time  the  student  lives 
with  the  respondent.    Both  parts  of  the  question  are  critical  items, 
and  both  elicited  high  rates  of  response.    Most  of  the  questionnaires 
(75.1  percent)  were  completed  by  the  child's  mother.    An  additional 
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13.7  percent  were  completed  by  the  child's  father.    A  little  more  than 
2  percent  of  the  respondents  gave  more  than  one  answer  to  the  question 
of  who  completed  the  questionnaire.    It  may  be  that  in  some  cases, 
parents  collaborated  to  provide  the  information.    It  may  be  useful  to 
insert  a  statement  in  the  instructions  that  tells  respondents  chat, 
while  it  is  all  right  to  collaborate,  one  parent  or  the  other  must  be 
represented  in  the  responses  to  such  questions  as  respondent's 
education  and  occupation. 

In  all  but  two  cases,  the  child  lives  with  the  respondent  more  than 
half  of  the  time. 

Respondent's  Race  and  Ethnicity 

Questions  1.9  and  1.10  ask  for  the  respondent's  national  origin  or 
descent  and  for  the  respondent '*  race,  respectively.    The  questions 
represent  a  deviation  from  the  earlier  HS4B  format,  in  which  ethnicity 
and  race  were  treated  in  a  single  question.    Question  1.9  is  concerned 
mainly  with  Hispanic  and  Asian  subgroups.    The  response  rates  to  the 
current  versions  of  the  questions  were  within  acceptable  limits.  The 
respondent  group  was  23  percent  Hispanic,  9  percent  Asian  or  Pacific 
Islander  and  63  percent  Other.    This  is  not  quite  consonant  wich  the 
results  from  question  1.10,  responses  to  which  describe  the  group  as  16 
percent  Black,  68  percent  White,  7.9  percent  Asian  or  Pacific  Islander, 
and  7.7  percent  Other. 

Language  Use 

Question  1.22  asks  whether  the  respondent  speaks  a  language  other 
than  English.  It  generated  a  high  rate  of  response  (only  0.4  percent 
invalid  responses).  Speakers  of  a  non-English  language  comprise  40.5 
percent  of  the  population. 

The  question  introduces  a  skip  pattern  in  which  the  non-English 
speakers  are  asked  a  series  of  questions  about  the  language  spoken, 
their  language  proficiency,  and  their  patterns  of  language  use  with  the 
study  child.    The  relatively  high  rates  of  "invalid"  data,  therefore, 
from  Questions  1.24,  1.25,  1.26,  1.27  and  1.28,  reflect  the  fact  that 
the  majority  of  the  respondents  (61  percent)  do  not  report  speaking  a 
non-English  language.    In  fact,  although  there  were  238  respondents  who 
reported  speaking  a  language  other  than  English,  there  were  as  many  as 
243  responses  to  the  four  parts  of  Question  1.24,  which  immediately 
follows  the  skip  and  asks  about  the    espondent's  fluency  in  the  non- 
English  language.    This  indicates  some  small  amount  of  confusion  in 
responding  to  the  skip.    The  remaining  critical  items,  1.25,  1.26, 
1.27,  and  1.28,  all  to  have  been  answered  only  by  those  who  reported 
speaking  a  non-English  language,  attracted  as  many  as  278  respondents, 
more  than  the  243  self-reported  non-English  speakers.    Each  of  these 
questions  appears  on  a  separate  page,  increasingly  distant  from  the 
original  Question  1.22  that  introduces  the  skip.    These  questions  all 
include  "English"  in  the  stem  or  among  the  options,  making  the 
confusion  understandable.    Revised  versions  of  these  questions, 
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Questions  1.24  and  1.25,  which  ask  about  the  respondent's  fluency  in 
both  the  non-English  language  and  English,  should  therefore  be  set  off 
more  clearly  wi';h  a  reminder  to  "Answer  only  if  you  speak  a  language 
other  than  English."     Questions  1.26,  1.279  and  1.28,  which  ask  what 
language  is  usually  spoken  in  the  hone,  which  language  the  respondent 
speaks  to  the  child,  and  which  language  the  child  speaks  to  the 
respondent,  should  either  be  set  off  in  the  same  fashion  as  Questions 
1.24  and  1.25,  or  should  be  asked  of  ALL  respondents  (no  fkip). 

Spanish  is  the  non-English  language  spoken  most  frequently  by 
respondents.    Just  under  25  percent  of  the  total  group  of  respondents 
report  speaking  Spanish  to  some  degree.    This  group  represents  60 
percent  of  those  who  report  speaking  a  non-English  languege  and  28.5 
percent  of  the  total  group. 

Level  of  Education 

Question  1.32  asks  for  the  highest  level  of  education  completed  by 
the  respondent.  The  question  is  identical  in  form  to  one  that  appeared 
in  the  Parent  Questionnaire  for  HS&B  in  1980  and  in  an  earlier  version 
as  well.  A  total  of  12.5  percent  of  the  eligible  respondents  provided 
invalid  responses,  most  of  them  vll.6  percent)  multiple  responses.  An 
additional  two  parents  refused  to  respond.  This  was  a  high  rate  of 
nonresponse  compared  with  the  questions  contiguous  with  this  one. 

In  fact,  this  pattern  of  multiple  responses  was  common  across  all 
of  the  items  that  ask  for  highest  level  of  education  attained  by  anyone 
(respondent,  spouse/partner,  etc.).    The  problem  can  be  handled  easily 
by  simply  using  the  highest  level  indicated  in  the  case  of  multiple 
responses. 

Employment  and  Occupation 

Question  1.34,  which  asks  whether  the  respondent  was  working  full- 
or  part-time  within  the  week  prior  to  completing  the  questionnaire, 
garnered  a  high  rate  of  response  (only  0.4  percent  invalid  responses). 
Approximately  three-fourths  of  the  respondents,  most  of  whom  are 
mothers,  report  holding  jobs. 

Questions  1.34A  and  B  were  to  be  answered  only  by  those  who 
indicated  that  they  were  not  working.    A  total  of  154  individuals 
responded  to  Question  1.34;  152  responded  to  1.34A,  and  162  to  1.34B, 
indicating  a  problem  once  again,  in  the  case  of  1.34B,  with  the  skip 

pattern.    Questions  34*  ind  34B  both  start,  "IP  NO,    "    The  latter 

question  might  be  improved  by  introducing  it  in  one  of  the  following 
ways:    "If  you  do  not  now  have  a  job,  ...."  or  "if  you  answered  "No"  to 
Question  34,  • •• •" 

Question  1.35B  is  an  open-ended  question  that  asks  respondents  to 
name  their  occupation.    This  was  compared  with  answers  that  parents 
gave  to  Question  1.35P,  a  long  closed  question  that  requests 
respondents  to  classify  their  oc^-pations  using  a  list  of  job 
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categories .    Though  there  may  be  some  difficulties  with  the  parent 
version  of  the  occupation  question,  even  with  these  difficulties,  a 
comparison  of  a  subs  ample  of  open-ended  and  closed-ended  patent 
responses  revealed  a  higher  degree  of  <   rrelation  than  a  similar 
comparison  of  student-reported  data,    fly  fine-tuning  the  occupation 
questions  in  the  Parent  Questionnaire,  the  chances  of  obtaining 
accurate  data  from  the  most  knowledgeable  respondent  should  improve. 
Thus,  it  seems  imperative  that  the  Parent  Questionnaire  ask  parents 
about  their  occupations  in  some  form. 

Question  1.39  asks  how  many  times  the  child  has  changed  schools 
since  entering  first  grade.    The  response  rate  was  high.    In  about  40 
percent  of  the  cases,  the  child  attended  only  one  school;  at  the  other 
end  of  the  continuum,  6.5  percent  of  che  parents  reported  that  the 
child  attended  five  or  more  schools. 

Locator  Information 

Questions  1.41,  1.42,  and  1.43  ask  for  locator  information,  namely 
the  names,  addresses,  and  telephone  numbers  of  the  respondent,  a  close 
relative,  and  a  family  friend,  respectively.     Different  data  elements 
in  these  questions  invited  different  rates  of  response  and  the  three 
questions  themselves  were  responded  to  at  different  rates. *  For 
example,  98.8  percent  of  the  respondents  pre  ided  their  own  last  name 
and  98.7  percent  provided  their  first  name.    Some  98.4  percent  of  the 
respondents  provided  a  street  address,  but  only  97.7  percent  (still  an 
acceptable  proportion)  provided  the  name  of  the  city  where  they  live. 
And  so  on.    All  of  the  respondent  information  was  within  acceptable 
limits,  except  that  6.2  percent  of  the  respondents  failed  to  supply  an 
area  code  with  the  telephone  number.    (The  area  code  was  provided 
consistently  less  frequently  than  any  of  the  other  data  elements  in 
these  three  questions).    It  is  recommended  that,  in  the  final  version 
of  these  questions,  the  space  for  area  code  be  made  more  clearly  a  part 
of  the  space  allotted  for  the  telephone  number,  as  follows: 

FIELD  TEST  VERSION:  (  ) 

Area  Code  Number 

RECOMMENDED  REVISED 

VERSION:      (  )  

Area  Code  Number 

Response  was  somewhat  bette*  to  all  of  the  data  elements  requested 
in  Question  1.41  than  to  any  of  the  data  elements  requested  in  Question 
1.42,  and  far  better  than  to  any  of  the  data  elements  requested  in 
Question  1.43.    Ir  other  words,  respondents  were  somewhat  less  likely 
to  provide  the  names,  addresses,  and  telephone  numbers  of  close 
relatives  than  they  were  to  provide  their  own,  and  far  less  likely  to 
provide  the  names,  addresses,  and  telephone  numbers  of  close  family 
friends  than  relatives'  or  their  own.    Inv  * *d  responses  comprised  8.8 
percent  of  the  eligible  response  to  a  reqt        for  a  relative's  last 
name,  11.1  of  the  response  to  a  request  fo;  a  relative's  address,  and 
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6.4  percent  for  a  relative's  telephone  number.    Over  a  third  of  the 
respondents  (36.6  percent)  failed  to  provide  the  name  of  a  family 
friend,  and  fewer  still  provided  the  address  or  telephone  number  of  a 
friend. 

Student's  High  School 

Questmen  1.44  asks  for  the  name  and  address  of  the  high  school  the 
child  is  expected  to  attend,  and  for  the  school's  telephone  number,  if 
that  is  known.    A  total  of  39  individuals  (6.4  percent)  failed  to 
provide  the  name  of  a  high  school,  and  12.5  percent  did  not  name  the 
city  in  which  the  high  school  is  located,  both  critical  items.    It  is 
entirely  within  the  realm  of  possibility  that  39  families  don't  know  or 
haven't  yet  decided  where  their  child  will  attend  high  school.  There 
is  no  discernible  structural  reason  for  the  response  rate  to  the 
question. 

The  Child's  Future;    Parent  Expectations 

Part  Twc  of  the  Parent  Questionnaire  contains  two  critical  items, 
one  about  the  respondent's  expectations  for  the  child's  education,  the 
other  about  specific  handicapping  conditions.    Question  2.1,  which  asks 
about  the  respondent's  expectations,  received  ineligible  responses  in 
8.2  percent  of  the  cases.    Much  of  this  ineligible  response  was 
nultiple  response  (7.5  percent).     Ir.  is  curious  that  the  rate  of 
ineligible  response  was  considerably  lower  (4.4  percent)  among  the 
respondents  who  were  mailed  the  questionnaire  by  the  school,  and 
slightly  higher  (10.1  percent)  among  those  who  received  the 
questionnaire  from  their  children. 

A  similar  question  in  HS&B  in  1980  ("How  far  in  school  do  you  want 
your  son/daughter  to  go?")  was  answered  by  virtually  all  of  the  parents 
who  responded.    With  retrieval,  the  rate  of  nonresponse  was  less  than 
one  percent. 

The  parents  surveyed  in  the  field  test  have  high  expectations  for 
their  children.    Forty-one  percent  of  those  who  responded  expect  their 
children  to  complete  college,  and  another  30  percent  expect  them  to 
earn  graduate  or  professional  degrees. 

Question  2.4,  which  asks  whether  the  child  has  any  or  all  of  a  list 
of  handicapping  conditions,  for  the  most  part  garnered  acceptable 
response  rates  (invalid  responses  ranging  from  3.9  lo  4.2  percent). 
The  one  exception  was  to  part  g  of  the  question  which  asks  if  the  child 

has  "Other  health  problem  (Write  in)  ."    Perhaps  the  need  to 

write  something  in  deterred  respondents.    For  the  base-year  survey,  the 
write-in  requirement  should  be  eliminated,  since  its  main  function  in 
the  field  test  was  to  identify  major  categories  of  response  not  treated 
in  the  existing  list.    The  proportions  of  students  with  the  listed 
problems  were  quite  low,  less  than  2  percent  in  the  case  of  all  but 
specific  learning  disabilities  (7.5  percent)  and  "Other  health 
problems"  (4.5  percent). 
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Child's  School  History 


Part  Three  of  the  questionnaire  contains  three  critical  items. 
Question  3.2  asks  whether  the  child  has  ever  received  special  services 
for  a  list  of  handicapping  conditions.    The  fonr— .  is  identical  to  the 
format  of  Question  2.4,  described  above,  with  the  exception  of  the 
addition  of  a  "Don't  Know11  response  option  for  each  condition.  The 
response  patterns  are  parallel  to  those  described  above.  Nonresponse 
generally  ranged  from  2.5  to  4.2  percent.    Again  the  one  exception  is 
the  "Other  health  problem1  choice.      Here  too,  the  respondent  was 
instructed  to  write  in  the  particular  health  problem.    Nonresponse  to 
this  one  part  of  the  item  vas  8.4  percent.    The  write-in  feature  of  the 
item  will  be  eliminated  in  the  revised  questionnaire.      The  proportions 
of  students  reported  to  have  received  the  listed  services  was  low  in 
most  cases,  except  for  speech  problems  (7.5  percent)  and  specific 
learning  problems  (8.5  percent). 

Question  3.3,  which  asks  whether  the  child  is  considered  to  have  a 
behavior  problem  at  school,  attracted  a  high  response  rate  (nonresponse 
was  only  0.6  percent).    According  to  the  respondent,  6.2  percent  of  the 
children  represented  by  the  parent  response  are  considered  to  have  a 
behavior  problem  at  school;  an  additional  1.9  percent  of  the  parents 
reported  that  they  don't  know  whether  their  child  has  a  behavior 
problem. 

Question  3.12,  which  is  about  the  child's  enrollment  in  bilingual 
and  ESL  (English  as  a  Second  Language)  programs,  special  services  for 
the  orthopedically  handicapped,  and  special  education  for  slow 
learners,  also  achieved  response  rates  of  95  percent  or  greater.  About 
10  percent  of  the  respondents  reported  children  enrolled  in  bilingual 
or  bicultural  programs,  3  percent  in  ESL  daises,  virtually  none  in 
special  services  for  the  orthopedically  handicapped,  3  percent  in 
special  services  for  slow  learners,  and  14  percent  in  gifted  and 
talented  programs. 


Family  and  Home  Environment 

The  two  critical  items  in  Part  Four  of  the  questionnaire  have  to  do 
with  who  is  home  when  the  child  returns  from  school,  and  with  the 
amount  of  time  the  child  spends  after  school  without  adult  supervision. 
Nonresponse  to  all  parts  of  Question  4.12  was  high.    The  question  lists 
nine  different  scenarios,  ranging  from  both  parents  being  at  home  when 
the  child  returns  from  school  to  no  one  being  at  home  when  the  child 
returns  from  school.    Nonresponse  for  these  nine  sub-items  ranged  from 
10.2  percent  for  the  respondent  ("You")  to  22.8  percent  for  "No  one." 
By  way  of  contrast,  the  rate  of  nonresponse  to  Question  4.13,  which 
asks  how  much  time  the  child  spends  after  school  without  adnlt 
supervision,  was  only  1  percent.    The  high  rate  of  nonresponse  to  all 
parts  of  Question  4.12  might  be  considered  a  reflection  of  respondents' 
feeling  that  these  questions  are  invasions  of  their  privacy,  but  that 
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explanation  it  weakened  by  the  relatively  high  response  rate  to 
Question  4.13.    In  any  case,  if  Question  4.13  can  be  considered  a 
satisfactory  substitute  for  Question  4.12,  the  latter  could  be 
t  el  initiated. 

There  is  considerable  variation  in  th?  actual  response  to  the 
V  various  parts  of  question  4.12.    For  example ,  among  those  who 

responded,  58  percent  of  the  respondents  reported  being  at  home  when 
the  child  returns  from  school,  20  percent  reported  another  adult 
relative  at  home,  7  percent  an  adult  neighbor.    In  33  percent  of  the 
complete  cases,  older  siblings  are  at  home  when  the  child  returns  from 
school,  and  in  44  percent  of  the  cases  younger  siblings  are  there. 
Clearly,  Question  4.12  offers  more  information  and  more  possibilities 
(through  cross-tabulations  and  other  combinations  of  the  sub-parts  of 
the  item)  for  creating  a  picture  of  the  after-school  supervision 
accorded  the  child  than  does  question  4.13. 

Parts  Pive  and  Six  of  the  questionnaire  contain  no  critical  items. 

Part  Seven  contains  critical  items  that  ask  about  total  family 
income  (Question  7.1),  and  about  money  set  aside  for  the  child's 
education  (Question  7.6). 

Total  Family  Income 

The  total  income  question,  whir    was  used  previously  in  HS&B,  has 
two  parts,  asking  separately  for  income  from  "wages,  salary, 
commissions,  or  tips  from  all  jobs,  before  deductions  for  taxes  or 
anything  else"  and  for  income  from  "work  you  did  on  your  own  or  in  your 
own  business  or  farm  (net  income,  that  is,  income  after  expenses.)" 
The  income  question  is  thus  both  complex  and  personal.    The  rate  of 
invalid  responsa,  therefore*,  while  higher  than  the  level  considered 
acceptable  here,  is  a  surprisingly  low  7.1  percent  for  the  wages  part 
and  a  higher  17.3  percent  for  the  business-and-f arm  part.    In  1960, 
when  it  appeared  in  the  parent  questionnaire  for  HS&B,  the  wages  item 
had  a  nonresponse  rate  of  9  percent,  and  nonresponse  to  the  wages-aad- 
farm  part  amounted  to  11.2  percent. 

It  is  difficult  to  sort  out  the  possible  sources  of  nonresponse. 
Again,  it  is  possible  that  some  respondents  find  the  question 
intrusive.    In  fact,  the  rate  of  outright  refusal  to  respond  was  higher 
for  Question  7.1  (5  percent)  than  for  any  other  question  in  the 
questionnaire.    Examining  the  question  itself,  it  is  obvious  that  the 
format,  the  ideas,  and  the  wording  are  also  forbidding c    (The  current 
question  is  identical  to  the  one  asked  in  HS&B,  and  should  really  be 
maintained  in  that  form  if  at  all  possible.)    For  both  parts  of  the 
income  question,  nonresponse  was  lowest  (5.7  percent  for  7.1A  and  14.1 
percent  for  7.18)  when  the  student  delivered  the  questionnaire  to  the 
respondent,  and  highest  (9.6  and  20.9  percent,  respectively)  when  NORC 
mailed  it,  suggesting  that  there  may  be  some  fear  that  the  information 
could  be  put  to  unknown  uses. 
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Among  those  who  responded,  the  modal  category  for  income  from 
wages,  salary,  etc.  was  $35,000  -  $49,999;  the  median  occurred 
somewhere  between  $25,000  and  $34,999.    Most  respondents  (59  percent  of 
those  who  responded)  reported  no  income  at  all  from  their  own  business 
or  farms. 

4.12.2.    Noncritical  Items 

This  section  deals  with  all  of  the  remaining  questions  in  the 
questionnaire.    For  noncritical  items,  a  threshold  of  8  percent  invalid 
responses  was  adopted.    Noncritical  items  with  greater  than  8  percent 
missing  data  will  be  described  in  some  detail,  with  some  discussion  of 
possible  reasons  for  the  nonresponse.    The  discussion  includes 
recommendations  for  revisions  to  items  with  unsatisfactory  response 
rates. 

Section  One;    Family  Background 

Questions  1.2,  1.3,  and  1.4,  all  intended  to  provide  information 
about  family  size,  ask,  respectively,  about  the  total  number  of 
dependents  of  -.he  respondent  and  his/her  spouse,  the  nuuber  of  siblings 
the  target  child  has.  and  the  number  of  older  siblings  the  target  child 
has.    All  of  these  items  produced  acceptable  rates  of  response. 

Questions  1.5A  and  1.5B  ask  for  the  numbers  of  the  respondents1 
children  who  are  now  in  high  school  anc*  who  are  now  beyond  high  school. 
Both  items  have  invalid  responses  in  greater  than  10  percent  of  the 
cases  (12.3  and  14.8  percent,  respectively).    This  relatively  high  rate 
of  invalid  data  is  undoubtedly  a  reflection  of  the  number  of 
respondents  who  have  no  children  in  high  school  or  beyond.  The 
nonresponse  can  be  eliminated  by  adding  the  direction  "Enter  a  number 
or  '0'"  in  each  case.    We  recommend  that  these  directions  be  added. 

Question  1.6  asks  whether  any  and  how  many  of  the  respondent's 
children  dropped  out  of  high  school  before  graduation     The  question 
was  intended  to  assess  the  extent  to  which  there  is  _  precedent  in  the 
family  for  leaving  school  early.    The  question  involves  a  skip,  in 
which  the  number  of  children  who  dropped  out  of  school  is  asked  only  of 
those  who  answer  the  initial  question  positively.    There  is  a  marginal 
response  rate  (8.3  percent  missing)  to  the  "yes/no"  part  of  the 
question,  arvj  e  very  high  rate  of  missing  data  for  the  question  that 
asks  for  the  number.    However,  this  is  a  function  of  the  skip  pattern. 
Cf  the  44  individuals  who  reported  having  a  child  drop  out  of  school 
before  graduation,  42  provided  a  number.    It  is  interesting  that  the 
nonresponse  for  this  question  was  lowest  (5.1  percent)  when  the  school 
mailed  the  questionnaire,  and  highest  (9.8  percent)  when  the  student 
delivered  the  questionnaire. 

Questions  1.7,  1.8  and  1.8A  ask,  respectively,  for  the  respondent's 
sex,  year  of  birth,  and  marital  status.    All  three  items  have 
acceptable  rates  of  response.    Question  1.8B,  which  asks  for  the 
spouse's  year  of  birth,  had  invalid  data  in  22.6  percent  of  the  cases. 
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Most  of  the  nonretpODte  is  attributable  to  thd  skip  pattern,  since  21.7 
percent  of  the  respondents  to  question  1.8A  reported  that  they  are  not 
now  currently  serried.    Obviously  a  few  respondents  reported  birth 
dates  for  former  or  nonexistent  spouses. 

Questions  1.11  and  1.12  ask  about  the  child's  mother's  place  of 
origin  and  the  year  that  she  came  to  the  United  States  to  live.  Two- 
thirds  of  the  respondents  report  having  been  born  in  the  United  States. 
The  low  response  rate  for  Question  1.12  (70  percent  invalid  responses), 
therefore,  reflects  an  appropriate  use  of  the  skip  pattern  by  most  of 
the  respondents  to  Question  1.11.    (A  follow-on  question,  1.12,  which 
asks  fox  the  mother's  occupation  before  she  came  to  the  U.S.,  lost  only 
.03  percent  of  che  potential  respondents,  that  is,  those  who  had  been 
born  elsewhere.)     Similar  patterns  were  found  for  Questions  1.14  and 
1.15,  which  ask  about  the  father's  place  of  birth  and  year  of  U.S. 
residency,  and  Questions  1.17  and  1.18,  which  solicit  the  same 
information  for  the  child. 

Questions  1.19,  1.20,  and  1.21  collectively  present  a  skip  pattern 
within  a  skip.    These  questions  ask  whether  the  child  attended  schoo1 
outside  of  the  United  States  (1.19)  and,  if  so,  the  grades  the  child 
completed  outside  the  U.S.  (1.20)  and  the  gride  the  child  was  assigned 
to  when  he/she  started  school  in  the  U.S.  (1.21).    These  tfrree 
questions,  by  virtue  of  the  skip  pattern  initiated  with  Question  1.17, 
were  to  have  been  answered  only  by  respondents  who  indicated  that  the 
child  had  been  born  outside  of  the  U.S.,  a  total  of  79  individuals  or 
20.0  percent.    However,  a  total  of  145  respondents  (an  extra  66 
individuals)  answered  Question  1.18.    Although  100  of  these  respondents 
said  that  the  child  did  non  attend  school  outside  the  U.S.,  it  is  not 
possible  to  tell  which  are  the  legitimate  respondents  to  the  question. 
This  confusion  jeopardizes  the  responses  to  questions  1.20  and  1.21. 
While  the  actual  numbers  of  those  circling  any  of  tt    options — a 
through  j —  for  Question  1.20  and  the  number  that  responded  to  question 
1.21  look  reasonable,  the  fact  that  so  many  extra  peonle  answered 
Question  1.18  casts  some  degree  of  suspicion  on  the  responses  to  the 
remaining  questions  in  the  series.    These  three  questions  are  good 
candidates  for  omission  from  the  base-year  survey. 

Question  1.23  asks  what  language  the  respondent  uses  most  often, 
and  is  one  in  a  series  of  questions  about  language  use.    The  question 
follows  a  critical  question  (Q.  1.22)  that  asks  if  the  respondent 
speaks  a  language  other  than  English.    Question  23  asks  what  language 
th?  respondent  uses  most  often.    The  high  rate  of  nonresponse  reflects 
a  reasonably  appropriate  use  of  the  skip  pattern  in  that  39.1  percent 
of  the  respondents  to  question  22  indicated  that  they  speak  a  language 
other  than  English  and  39.9  percent  of  the  field-test  sample 
respondents  answered  question  23. 

Question  1.29  is  another  in  the  language  use  series  within  the  skip 
pattern.    It  asks  what  other  language  is  spoken  in  the  respondent's 
home.    The  nonresponse  rate  of  57.3  percent  is  a  fairly  good  match  with 
the  39.1  percent  who  report  speaking  a  language  other  than  English, 
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indicating  that  the  skip  pattern  was  accurately  uced  by  respondents. 
However,  *  fair  number  cf  respondents  selected  more  than  one  language 
in  response  f>  this  question,  in  which  the  instructions  were  ostensibly 
to  select  one.    Sine*,  it  is  not  inconceivable  that  some  speakers  of  a 
non-English  language  speak  more  than  one  non-English  language,  the 
question  should  be  revised  to  make  such  a  possibility  an  at:eptable 
response. 

Questions  1.30  and  1.31  ask  about  religious  preference  and  marital 
status,  respectively.    Both  have  acceptable  rates  of  response. 

Question  1.33  asks  for  the  highest  level  of  e»f ^cation  attained 
by  the  respondent's  spouse  or  child's  other  guardian.  The  question  was 
previously  used  in  HS&B.    Despite  the  fact  that  there  is  an  option  to 
circle  if  the  child  does  not  have  another  gu; rdian  (selected  by  5.6 
percent  of  the  respondents),  nonresponse  to  this  item  amounted  to  16.7 
percent,  again  because  of  a  high  rate  of  multiple  response  (11.4 
;tercent).    Again,  this  should  be  handled  by  using  the  highest  level 
inu: rated  in  the  case  of  multiple  response.    The  rate  of  nonresponse, 
incidentally,  was  somewhat  lower  (11.0  percent)  when  the  school  mailed 
the  questionnaire  to  the  respondent,  and  somewhat  higher  (21.0  percent) 
*hen  the  student  delivered  the  questionnaire. 

Question  1.35  is  a  multi-part  question  that  asks  about  the 
respondent's  present  or  most  recent  job.    It  is  part  of  a  skip  pattern 
with  Question  1.34,  a  critical  item  considered  earlier,  and  is  supposed 
to  be  answered  only  be  individuals  who  are  currently  working  or  who 
have  held  a  regular  job  in  the  past.    The  question  was  used  in  HS&B  in 
1980.    It  is  intended  to  contribute  to  a  measure  of  socioeconomic 
status.    Several  aspects  of  the  job  are  asked  about;  self-employment 
vs.  working  for  someone  else  (35A);  job  title  (35B,  open  ended);  job 
responsibilities  (35C,  open  ended);  name  of  employer  (35D,  o;.en  ended); 
nature  of  workplace  (35E,  open  ended);  and  a  categorical  response  list 
tnat  characterises  the  job  (35P).    Retponces  to  the  two  f i~*d-choice 
segments  of  the  question  were  marginal;    nonresponse  was  8.8  and  9.0 
percent,  respectively,  to  questions  35*     d  ?*?.    About  half  of  the 
nonresponse  to  question  1.35P  is  accounted  for  by  multiple  responses, 
indicating  either  that  the  respondent  had  difficulty  deciding  on  a 
single  appropriate  category  or,  perhaps,  actually  holds  two  jobs.  The 
possibility  of  more  than  orw.  job  should  be  allowed  for  in  the 
instructions  to  the  question,  eiti.ir  by  having  the  respondent  answer  in 
terms  of  the  job  that  occupies  the  greater  amount  of  rime,  or  in  terms 
of  both  jobs. 

Questions  1.36  and  1.37  repeat  the  employment  questions  for  the 
respondent's  spouse  or  child's  current  guardian.    The  initial  question 
(1.36,  was  spouse/guardian  working  full  or  part-time  during  the  week 
prior  to  the  survey?)  was  not  answered  by  14.5  percent  of  the  sample. 
Nonresponse  to  the  fixed  choice  follow-on  questions  (1.37A  and  1.37P) 
amounted  to  21.9  ana  24.6  percent,  respectively.    There  is  no  way  to 
tell  how  much  of  the  nonresponse  reflects  the  absence  of  a  spouse  (only 
76  percent  or  the  respondents  reported  being  married)  or  other 
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guar di in,  how  ouch  it  because  the  respondent  simply  doesn't  know,  and 
how  much  is  attributable  to  other  sources.    At  the  very  least,  a 
revised  version  of  the  question  might  include  a  check-off  for  the 
absence  of  a  spouse  or  other  partner. 

Question  1.38  asks  for  the  highest  level  of  education  attained  by 
the  respondent's  father.    It  is  identical  in  format  to  the  other 
education  items  in  the  questionnaire.    The  rate  of  ineligible  response 
was  an  unacceptable  13,2  percent,  which  is  fairly  consistent  with  the 
performance  of  other  education  items.    In  this  instance,  only  3.5 
percent  of  the  ineligible  response  is  attributable  to  multiple 
responses. 

Question  1.40  asks  how  Ion*  the  child  has  been  at  his/her  current 
school.    The  response  rate  was  high. 

Section  Two;  The  Child's  Future 

Questions  2.2  end  2.3  ask  who  is  expected  to  influence  the  child's 
plans  for  high  school  and  who  will  have  the  most  influence  with  respect 
to  the  child's  plans  for  high  school.      Both  items  had  acceptable 
response  rates ,  the  former  higher  than  the  latter. 

Section  Three;  The  Child's  School  Life 

Question  3.1  is  a  multi-part  question  that  asks  about  the  child's 
attendance  at  day  care,  nursery  school,  Head  Start,  kindergarten,  and 
extended  day  programs.    Despite  the  fact  that  there  is  a  "Don't  Know" 
option,  the  response  rates  ranged  from  acceptable  (7.4  percent 
nonresponse  for  kindergarten)  to  unacceptable  (25. 1  for  extended  day). 
The  most  productive  parts  of  the  question  in  terms  of  response  rate 
were  3. IB  (nursery  or  preschool)  and  3. ID  (kindergarten).    For  all 
parts  of  the  question,  nonresponse  was  least  for  t!  2  group  of 
questionnaires  mailed  by  the  school. 

Question  3.4  follows  critical  item  3.3  (which  asks  whether  the 
child  is  considered  to  have  a  behavior  problem  at  school)  and  asks 
whether  the  child  was  ever  considered  to  have  a  behavior  problem  at 
chool.    The  response  rate  was  high. 

Questions  3.5,  3.6,  and  3.7  ask  whether  the  child  et  v  snipped  a 
grade,  either  at  the  parent's  request  (Question  3.5)  or  because  the 
school  recommended  it  (Question  3.6),  and,  if  the  child  was  skipped, 
what  grade(s)  he/sb?  skipped  (Question  3.7,  a  skip).    Response  rates  to 
the  first  two  questions  were  high,  and  nhe  skip  pattern  was  used 
appropriately. 

Questions  3.8,  3.9,  and  3.10  are  a  parallel  set  having  to  do  with 
whether  the  child  ever  repeated  a  grade.    Response  rates  were  similarly 
high  and  tbr  skip  pattern  was  used  appropriately. 
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Question  3.11  asks  whether  the  child  was  read  to  before  he/she 
could  read  his/her self .    The  response  rate  was  marginal;  8.7  percent 
failed  to  respond. 

Question  3.13  asks  whether  the  child  is  enrolled  in  a  gifted  or 
talented  program.    If  he  or  she  is,  the  respondent  is  asked  to  react  to 
a  milti-part  question  (3.14)  about  the  potential  benefits  of  such  a 
program.    The  response  rate  on  Question  3.13  was  acceptable;  however, 
many  mor-s  individuals  responded  to  Question  3.14  than  indicated  that 
their  children  were  enrolled  in  a  gifted  and  talented  program  (229 
compared  with  83  who  were  legitimate  respondents  to  the  question).  If 
question  3.14  is  retained,  the  skip  pattern  should  be  made  clearer,  or 
the  Question  should  be  asked  of  all  respondents. 


Section  4;    Home  Environment 

Questions  4.1  and  4.2  ask,  respectively,  how  many  books  the 
respondent  read  during  the  past  year  and  whether  there  is  a  computer  in 
the  home  that  is  used  for  educational  purposes.    Both  items  garnered 
high  rates  of  response. 

Question  4.3  asks  whether  the    hild  attends  each  of  a  series  of 
out-of-school  classes.    Nonresponse  to  all  parts  of  the  question  was 
higher  than  the  acceptable  level,  ranging  from  10.7  to  17.3,  and  rising 
to  38.1  for  the  "other"  option.    This  was  a  "yes/no"  question. 

Questions  4.4  and  4.5  ask  whether  the  respondent  has  rules  for  the 
child  about  television,  and  whether  the  respondent  enforces  rules  about 
grades,  homework  and  household  chores.    Response  rates  to  both 
questions  were  marginally  acceptable—nonresponse  amounted  to  7.5 
percent  in  both  cases. 

Questions  4.6,  wlich  asks  how  satisfied  the  respondent  has  been 
with  the  child's  education  so  far,  was  completed  by  all  but  1.2  percent 
of  the  respondents.    This  question  was  also  used  in  HS&B  in  1980. 

High  response  rates  were  also  the  norm  for  questions  4.7  through 
4.11,  touching  on  helping  the  child  with  homework,  and  talking  with  the 
child  about  school,  his/her  report  card,  and  plans  for  after  high 
school.    Questions  4.4,  4.9  and  4.10,  were  also  used  in  HS&B. 

Question  4.14  asks  whether  the  respondent  and  the  child  borrow 
books  from  the  library,  attend  concerts,  and  go  to  art  and  science 
museums.      Rates  of  nonresponse  to  each  of  the  eight  parts  of  the 
question  range  fT  m  4.8  percent  for  child's  borrowing  books  from  the 
public  library  to  7.9  percent  for  child's  attendance  at  art  museums. 
These  are  acceptable  response  rates.    Response  rates  to  all  parts  of 
this  question  were  highest  for  the  group  of  questionnaires  mailed  to 
the  respondents  by  the  school. 
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Section  Five:  Parent 's  Contact  With  Child  s  School 
Section  Six;  Parent's  Opinioni  About  Child's  School 


All  of  the  questions  in  Section  Five  of  the  questionnaire,  which 
ask  about  the  respondent's  contact  with  and  participation  in  the 
child's  school,  have  acceptably  high  rates  of  response.    Similarly,  all 
parts  of  the  single  mlti-part  question  in  Section  Six  that  asks  for 
the  respondent's  attitudes  toward  the  child's  school  and  the  child's 
relationship  to  it  have  acceptably  high  rates  of  response. 

Section  Seven:  Family  Income  and  Educational  Costs 

Section  Seven  treats  the  dual  issues  of  family  finances  and 
educational  costs.    The  income  question  has  been  discussed  along  with 
other  critical  items.    Question  7.*,  whether  there  is  one  parent  or  two 
in  the  household,  was  responded  to  by  98.5  percent  of  the  sample. 

Question  7.3  asks  for  the  amount  the  respondent  currently  owes,  how 
much  money  he/she  has  in  current  savings,  and  how  much  he/she  had  in 
savings  at  the  same  time  last  year.    These  questions  employ  the  same 
format  as  the  total  family  income  question,  asking  respondents  to 
choose  a  categorical  response  from  a  list  and  enter  the  letter  of  that 
response  in  a  box.    The  three  parts  of  the  question  each  have 
nonresponse  rates  of  less  than  3  percent,  indicating  that  the 
respondents  are  able  to  use  the  format  successfully. 

Question  7.4  introduces  a  complicated  series  of  questions  (that 
includes  Questions  7.5A  and  5B-a  through  1)  about  current  expenses  for 
education.    Question  7.4  asks  whether  the  respondent  is  currently 
paying  private  or  religious  school  tuition,  college  tuition,  or  for 
tutoring  for  any  of  his/her  children.    The  response  rates  to  the  three 
parts  cf  this  question  vary  from  acce  table  (nonresponse  =  5.8  percent) 
for  the  private  and  religious  school  tuition  part,  to  11.8  percent 
nonresponse  for  the  college  tuition  part,  to  13.3  percent  nonresponse 
for  the  tutoring  part.    If  the  response  is  "yes"  to  any  one  of  the 
three,  the  respondent  is  directed  to  indicate  (again  using  a  list  of 
ranges  of  dollar  amounts)  the  total  amount  spent  during  the  current 
school  year  for  all  expenses  represented  (Question  5A)  and  to  check  any 
or  all  of  the  sources  of  money  used  (from  a  list)  to  meet  the  expenses. 
Because  of  the  complicated  contingency  in  this  item  (respondents  might 
be  routed  to  Question  7.5  by  virtue  of  having  checked  one,  two,  or 
three  educational  expenditures),  it  is  difficult  to  tell  whether  the 
skip  pattern  was  used  appropriately.    A  total  of  316  respondents 
indicated  at  least  one  type  of  educational  expenditure,  and  a  total  of 
263  individuals  responded  to  Question  5A.  (Not  surprisingly,  the  number 
that  responded  to  any  of  the  choices  in  Question  5B  was  much  smaller.) 
This  may  or  may  not  be  an  accurate  reflection  of  the  number  who 
actually  reported  educational  expenditures. 

The  last  question,  Question  7.7,  presents  a  series  of  ten 
statements  related  to  the  family's  beliefs  and  expectations  about 
financing  higher  education  for  the  target  child.    These  questions  were 
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used  in  HS&B.    Nonresponse  ranged  from  5.9  to  7.0  percent  of  the 
sample,  all  acceptable  levels. 

4.13>        Comparisons  of  Data  Gathered  Via  Parent  and  Student 
Questionnaires 

Some  questions  were  asked  of  both  parents  and  students.  One 
purpose  of  this  seeming  redundancy  was  to  assess,  for  purposes  of  the 
field  test,  which  was  the  better  respondent.    Another  purpose  was  to 
assess  the  reliability  of  the  information  provided. 

Socioeconomic  Status;    Parent  Education  and  Occupation 

By  far  the  most  important  of  the  questions  asked  of  both  sets  of 
respondents  are  the  questions  that  ask  about  parental  occupation 
(Questions  1-35  and  1-37  in  the  Parent  questionnaire)  and  education 
(Questions  1-33  and  1-34),    Their  importance  rests  with  the  fact  that 
the  items  contribute  to  a  measure  of  socioeconomic  status  which,  in 
turn,  is  expected  to  be  related  to  many  of  the  outcomes  assessed  in 
HMLS88. 

it  is  often  the  case  that  young  students  are  unaware  of  their 
parents1  educational  attainments.    In  the  National  Assessment  of 
Educational  Progress  (NAEP),  students  at  the  seventhrgrade/13  year-old 
level  were  considerably  more  likely  than  students  in  eleventh-grade/ 17- 
year  cohort  to  choose  the  "I  don't  know91  option  in  the  parent  education 
question,    (NAEP  did  not  ask  about  parents 'occupation, )  Consistent 
with  this  finding,  questions  about  parents1  education  in  the  NELS:88 
field  test  student  questionnaire  showed  high  rates  of  nonresponse. 

While  nonresponse  to  the  parent  education  questions  on  the  Parent 
Questionnaire  was  higher  than  the  acceptable  maximum,  the  nonresponse 
was  considerably  lower  than  nonresponse  to  the  same  questions  on  the 
Student  Questionnaire,    Students1  frequent  use  of  the  "Don't  Know" 
option  suggests  that  they  really  don't  know,  and  that  the  question  is 
better  asked  of  parents  at  this  age. 

NORC  created  a  composite  SES  variable  using  mother's  and  father's 
occupations  and  mother1 s  and  father's  education,  separately  for  the 
data  obtained  from  parents  and  the  data  obtained  from  students.  In 
addition,  the  results  were  tabulated  separately  and  compared  for  each 
of  the  data  elements  separately. 

Because  of  the  high  rates  of  nonresponse  to  the  education  items  on 

the  part  of  both  parents  and  students,  only  about  half  of  the  parents' 

education  data  could  be  matched  with  student  data  (393  of  the  775 

cases,  representing  51  percent  of  the  father's  education  data  and  420 
or  54  percent  of  the  mother's  education  data),  of  which  232  and  240, 

respectively,  were  in  agreement,  and  161  (41  percent)  and  180  (43 
percent)  disagreed. 
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Similarly  discouraging  levels  of  disagreement  were  observed  for  the 
occupation  questions  (See  Section  3.2.7.1  for  a  more  detailed 
description  of  the  nature  of  the  discrepancy.)    Even  after  a  recoding 
procedure  was  introduced  by  NORC  to  reduce  the  amount  of  disagreement, 
the  percentage  of  disagreement  for  individual  categories  of  father's 
occupation  varies  from  0  to  64,  and  for  mother's  occupation  from  33  to 
83. 

Using  a  composite  variable  serves  to  increase  the  number  of  matches 
that  can  be  made  (625  of  the  775  extant  parent  cases),  allowing  for  the 
construction  of  an  SES  measure  in  81  percent  of  the  cases.    It  should 
be  noted  that  relatively  more  parents  (54  percent)  t  an  students  (35 
percent)  supplied  all  four  of  the  data  elements  that  make  up  the 
composite,  and  that  the  unmatched  cases  are  due  mainly  to  the  absence 
of  data  from  students.    Moreover,  the  rate  of  disagreement,  28  percent, 
is  still  quite  high.    Common  sense  and  the  field  test  data  together 
suggest  that  parents  are  better  informants  than  eighth-grade  students 
about  their  (the  parents')  education  and  occupation. 

The  critical  nature  of  the  SES  variable  and  the  data  elements  that 
contribute  to  it,  combined  with  the  comparative  superiority  of  parents 
over  students  in  providing  these  data  accurately,  suggests  a  sample 
design  that  maximizes  the  participation  of  parents,  even  at  the  expense 
of  a  shorter  questionnaire.    At  tt»a  very  least,  the  occupation 
questions  in  the  parent  questionnaire  should  be  made  critical  and 
subject  to  additional  retrieval  efforts. 

Early  Educational  Experiences 

Parents  and  students  were  asked  parallel  questions  about  the 
student's  early  educational  experience,  specifically  whether  (s)he 
attended  day  care,  nursery  school,  Head  Start,  kindergarten,  or 
extended  day  programs  (Question  3-1 .a  through  e  in  the  Parent 
Questionnaire).    Parent  and  student  responses  are  presented  in  tabular 
form  in  section  3.2.7.2.    The  crosstabulations  reveal  a  fair  amount  of 
disagreement  between  parents  and  students  on  these  items.    Much  of  the 
disagreement  is  accounted  for  by  students1  use  of  the  "Don't  Know" 
option  in  cases  in  which  their  parents  are  able  to  provide  yes  or  no 
answers.    There  is  also  a  higher  rate  of  all  forms  of  nonresponse  for 
students  than  for  their  parents  (except  in  the  case  of  extended  day 
programs,  to  which  there  was  nonresponse  amounting  to  25  percent  of 
parent  respondents  and  39  percent  of  students).    It  is  therefore 
recommended  that  parents  be  the  primary  source  of  the  information 
requested  in  this  question  in  the  base  year.    Since  the  extended  day 
category  engendered  such  confusion,  it  should  be  better  defined  or 
dropped  entirely. 

Special  Services 

Parents  and  students  were  both  asked  sets  of  questions  about 

special  services,  one  set  about  past  involvement  in  various  special 

services  (Question  3-2. a  through  g  in  the  Parent  Questionnaire)  and 
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another  about  current  involvement  in  such  services  (Question  3-12. a 
through  d).    In  the  specific  instances  of  special  services  for 
orthopedic  handicap  (Questions  3-2 .e  and  3.12.C  in  the  Parent 
Questionnaire)  and  special  services  for  learning  problems  (Questions 
3.2. f  and  3.12.d),  there  are  close  correspondences  between  the 
questions  asked  parents  and  students.    NORC  conducted  both  inter-item 
consistency  checks  for  similar  items  within  questionnaire?,  and 
inter-respondent  consistency  checks  for  similar  items  acr<  ss  the  two 
questionnaires  (see  section  3.2.4).     With  respect  to  orthopedic 
handicap,  parents  were  consistent  in  their  responses  100  percent  of  the 
time.    However,  comparing  student  and  parent  responses,  consistency  was 
high  only  when  both  parent  and  student  answered  the  question? 
negatively,  that  is,  to  indicate  that  the  student  had  not  received  nor 
was  at  the  time  of  the  field  test  receiving  such  services.  When 
students  said  they  vere  enrolled  in  such  services,  their  parent* 
disagreed  with  them  100  percent  of  the  time.    NORC  telephoned  10  of  the 
pairs  with  inconsistent  responses  and  discovered  that  parents  and 
students  had  interpreted  the  questions  differently.    NORC  concluded 
that  parents  had  more  accurately  interpreted  the  meaning  of  the 
question  than  had  their  children. 

The  learning  disabilities  question  contains  a  slight  variation  in 
the  Parent  and  Student  Questionnaires,  although  inter-item  and 
inter-rater  analyses  were  conducted  as  if  they  were  identical.  Parents 
were  internally  consistent  overall  more  than  99  percent  of  the  time, 
but  their  internal  consistency  in  the  case  of  affirmative  responses  to 
the  question  amounted  to  only  62 .5  percent.    This  was,  however,  higher 
than  the  internal  consistency  of  students,  who  disagreed  with 
themselves  72  percent  of  the  time.    There  was  even  greater 
inconsistency  between  parents  and  students  in  their  reporting  of 
services  for  learning  disabilities,  amounting  to  disagreements  in  the 
case  of  affirmative  responses  of  50  and  72  percent. 

Summarizing  across  these  analyses,  it  would  appear  that  parent 
response  to  the  specific  questions  about  the  student's  receipt  of 
services  for  orthopedic  handicaps  and  specific  learning  disabilities  is 
more  reliable  than  student  response.    These  questions  are  therefore 
better  asked  of  parents.  (By  implication,  parents  may  be  better 
informants  about  all  special  services.) 


4.14       Conclusions  and  Recommendations 

On  the  basis  of  analyses  of  patterns  of  response,  patterns  and 
levels  of  nonresponse,  and  comparisons  between  data  collected  via 
parent  and  student  questionnaires,  some  items  emerge  as  candidates  for 
revision  and  others  for  possible  elimination,  depending  on  the 
importance  of  the  information  desired.    A  discussion  of  each  of  the 
questionable  items  follows. 

Question  1.1A,  a  critical  item    which  asks  about  the  relationship 
of  the  respondent  to  the  student,  garnered  some  (small)  number  of 
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cmiltiple  responses ,  suggesting  that  parents  or  guardians  may  be 
collaborating  in  completing  the  questionnaire.    The  multiple  response 
would  not  be  destructive  were  it  not  for  the  fact  that  the  identity  of 
the  respondent  is  established  in  this  question  and  will  later  be 
matched  with  the  education  and  occupation  questions  which  ask  for 
"your"  (nighest  level  of  education)  as  distinct  from  "your 
spouse/pat tner's"  (highest  level  of  education).    It  is  recommended  that 
some  instruction  be  added  to  the  question  or  at  the  beginning  of  the 
questionnaire  about  identifying  a  single  respondent  even  if  two  or  more 
individuals  complete  the  questionnaire  together. 

Questions  1.5A  and  1.5B,  noncritical  items,  ask  how  many  of  the 
respondent's  children  are  in  high  school  and  college,  respectively,  and 
h*J  higher  than  acceptable  rates  of  nonresponse.    It  is  recomnended 
that  the  instruction  "Enter  a  number  or  '0'"  be  added  to  the  stem  to 
ensure  that  the  nonresponse  really  does  reflect  the  case  of  no  children 
in  a  given  category. 

Questions  1.17  through  1.21  are  about  whether  the  child  attend 
school  outside  the  United  States  and,  if  (s)he  did,  about  what  grade(s) 
were  completed  and  his/her  grade  placement  upon  entry.    The  series 
contains  a  complicated  series  of  skips  and  there  is  evider  j  that  the 
pattern  was  not  used  well  by  the  respondents.    These  questions  should 
be  simplified  and/or  clarified.    Perhaps  not  all  of  the  information  is 
necessary. 

Question  1.22  asks  about  language  use  in  the  respondent's  home  and 
introduces  a  skip  pattern  in  which  speakers  of  a  non-English  language 
are  asked  a  series  of  questions  about  the  language(s)  used  and  the 
frequency  of  use.    The  skip  pattern  seems  to  have  engendered  some  level 
of  confusion,  since  more  people  responded  to  the  questions  about  non- 
English  language  use  than  should  have  considering  the  number  who 
indicate  such  use  in  Question  1.22.    Several  of  the  questions  within 
the  skip  pattern  appear  on  new  pages,  and  could  be  interpreted  as 
applying  to  all  respondents.    It  is  therefore  recommended  that  ail  of 
the  questions  within  the  skip  be  introduced  with  a  phrase  like,  "If  a 
language  other  than  English  is  spoken  in  your  home,  ...  ". 

Question  1.29  is  part  of  the  skip  pattern  and  asks  what  other 
language,  in  addition  to  the  non-English  language  specified  earlier, 
is  spoken  in  the  respondent's  home.    This  question  attracted  multiple 
responses  although  it  was  intended  as  a  single-response  item.    Since  it 
is  not  unreasonable  to  assume  that  more  than  one  language  may  be  spoken 
in  some  homes,  it  may  be  well  to  change  the  question  to  one  that  allows 
for  multiple  responses. 

Question  1.33  asks  about  the  respondent's  education.    It  is  a 
question  from  HS&B  and  a  critical  item.    It  and  several  other  questions 
that  use  the  same  general  format  ("What  is  the  highest  level  of 
education  you  (or  someone  else)  have  completed?")  attracted  the  highest 
rates  of  multiple  response  of  any  question  in  the  Parent  Questionnaire 
(12  percent  in  the  case  of  respondent's  education  and  11  percent  in  the 
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case  of  spouse/pavtner's).    Since  the  question  should  be  retained 
essentially  intact  for  reasons  of  continuity,  it  is  recommended  that 
niltiple  responses  be  dealt  with  simply  by  counting  only  the  highest 
level  checked* 

Question  1.35  is  a  multi-part  question  that  describes  the 
respondent's  occupation.    The  item  was  used  in  HS&B  and  the  data  it 
provides  will  contribute  to  a  measure  of  family  SES.    In  an  earlier 
section,  the  performance  of  this  item  was  compared  with  the  results 
froa  a  similar  item  asked  of  students,  leading  to  the  conclusion  that, 
at  least  in  the  case  of  eighth-grade  students,  parents  are  better 
sources  of  information  about  their  own  occupations  than  are  students. 
This  is  particularly  true  in  the  case  of  Question  1.35P,  which  asks  the 
respondent  to  'elect  from  a  list  of  categories  the  one  that  comes 
closest  to  describing  his/her  job.    Comparing  the  categorised  responses 
with  the  responses  provided  to  1.35B,  which  asks  for  the  same 
information  in  open-ended  fashion,  correspondence  between  the  two 
sources  was  better  for  parents  than  for  students.    Per  this  reason,  it 
;-s  recommended  that  Question  I.35P  (and  perhaps  the  entire  series)  be 
made  a  critical  item,  subject  to  intensive  efforts  at  retrieval  in  the 
case  of  nonresponse. 

Question  1.3SP  also  attracted  multiple  responses  in  almost  5 
percent  of  the  cases.    It  is  entirely  possible  that  any  given 
resporttent  may  have  more  than  one  job.    Some  instruction  about  multiple 
jobs  should  be  provided  in  the  stem  of  the  item. 

Questions  1.36  and  1.37  are  parallel  to  Questions  1.34  and  1.35, 
but  ask  about  the  spouse/partner's  job.    It  is  recommended  that  these 
items  be  made  critical  along  with  items  1.34  and  1.35.    Since  the 
majority  of  the  questionnaires  are  completed  by  the  mother,  and  since 
father1  s  occupation  is  frequently  more  influential  than  mothers  in 
determining  family  SES,  father's  occupation  seems  a  critical  piece  of 
information.    Subjecting  father1 s  occupation  to  retrieval  along  with 
mother's  should  maximise  the  chance  of  getting  at  least  one  parent's 
occupation  to  contribute  to  the  family  SES  variable.    It  goes  without 
saying  that  any  revisions  to  Questions  1.34  and  1.35  should  also  be 
made  to  Questions  1.36  and  1.37. 

Requests  for  locator  information  received  variable  response.  The 
area  code  was  the  most  frequently  omitted  single  piece  of  information, 
and  a  suggestion  for  a  revised  format  has  already  been  recommended. 
Since  the  locator  information  is  central  to  the  purpose  of  the 
questionnaire,  it  is  assumed  that  the  locator  questions  (1.41,  1.42, 
.and  i.43)  should  remain  essentially  as  they  are.    Locator  information 
about  a  close  family  friend  (Question  1.43)  is  the  least  likely  to  be 
provided,  and  should  therefore  be  the  top  candidate  for  elimination,  if 
any  of  the  locator  questions  can  be  eliminated. 

If  the  rate  of  nonresponse  is  any  indication,  many  parents  do  not 
know  where  their  children  will  be  attending  high  school.    Since  this 
piece  of  information  is  an  important  element  in  the  locator  series, 
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Question  1.44,  which  atkt  it,  should  remain  a  critical  item,  subject  to 
retrieval. 

Question  2.1,  which  asks  how  far  the  parent  expects  the  child  to  go 
in  school,  has  the  same  problem  with  high  rate  of  multiple  response  as 
other  questions  about  education.    The  same  tactic  should  be  employed 
with  this  item,  that  is.  the  highest  level  marked  should  be  taken  as 
the  response  in  cases  of  multiple  response. 

Question  2.3  is  a  candidate  for  elimination.    It  asks  who  the 
parent  feels  is  most  influential  in  deciding  a  student's  plans  for  high 
school.    About  five  percent  of  those  who  responded  gave  more  than  one 
answer.    If  the  item  is  retained,  the  stem  should  be  reworded  to 
emphasise  the  fact  that  a  single  response  is  desired. 

In  Question  2.4,  and  again  in  its  parallel,  Question  3.2,  part  g  of 
the  question  should  be  eliminated,  or  th*  write-in  feature  of  it  should 
be  eliminated. 

In  Question  3.1,  the  "Extended  day"  option  should  either  be  dropped 
or  defined. 

Question  3.11,  which  asks  whether  the  child  was  read  to  before 
(s)he  could  read  him/herself,  is  a  candidate  for  elimination.  Nine 
percent  of  the  respondents  did  not  answer  this  question* 

Questions  3.13  and  3.14  are  about  gifted  and  talented  programs  and 
involve  a  skip  pattern  that  was  not  used  correctly  by  respondents.  If 
Question  3.14  is  to  be  retained  (and  the  relevance  of  the  question  to 
the  NBLS:88  outcomes  is  not  clear),  either  the  stem  should  make  it 
clear  that  it  is  to  be  answered  only  by  those  whose  children  are  in 
such  programs,  or  it  shouli  be  opened  to  all  respondents. 

Question  4.2,  which  asks  about  the  child's  enrollment  in  out-of- 
school  classes,  had  margin*'  rates  of  response,  as  did  Questions  4.4 
and  4*5,  which  ask  about  ruj.es  governing  the  child's  behavior.  These 
questions  are  candidates  for  elimination. 

Question  4.12,  which  asks  about  specific  individuals  who  might  be 
at  home  when  the  child  returns  from  school,  should  be  simplified  by 
grouping  the  individuals  into  categories  ("adult  family  member",  for 
example)  or,  preferably,  eliminated. 

Much  of  Section  Seven,  which  deals  with  financial  information,  is 
problematic.    Response  rates  are  low  and  skip  patterns  are  poorly 
adhered  to.    Question  7.1,  which  asks  for  family  income,  has  been 
discussed  elsewhere.    It  is  a  critical  item,  and  will  contribute  to  the 
SBS  measure.    Moreover,  it  was  used  in  HS&B.    It  should  therefore  be 
retained  in  its  present  form  and  strong  efforts  should  be  made  to 
retrieve  information  not  provided.    Questions  7.4  and  7.5  together  form 
a  complicated  skip  pattern  which  was  not  appropriately  used.    If  the 
item  is  to  be  retained  (and  a  case  may  be  made  for  eighth  grade  being 
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too  early  to  ask  about  the  impact  of  current  educational  expenses  on 
the  post secondary  education  plans  for  a  given  child),  the  skip 
instructions  should  be  reworded  and  reformatted* 
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5.  FIELD  TEST  RESULTS  OF  THE  SCHOOL  AND  TEACHER  SURVEYS1 


The  National  Education  Longitudinal  Study  of  1988  (NEL&88)  seeks  to  gather  trend 
data  about  critical  transitions  experienced  by  young  people  as  they  develop,  attend  school,  and 
embark  on  careen.  NEL&88  focuses  on  a  sample  of  students  enrolled  in  the  eighth  grade  in  the 
1988  academic  year.  During  the  base-year  of  the  study,  the  sample  of  students  will  be 
administered  a  student  questionnaire  and  a  cognitive  test  battery  intended  to  measure  cognitive 
growth  over  time  in  reading,  mathematics,  science,  and  social  studies.  These  data  are  to  be 
supplemented  by  a  school  survey  directed  at  the  principals  in  schools  where  the  participating 
students  are  enrolled,  a  survey  of  selected  teachers  of  participating  students,  and  a  parent  survey 
of  a  sample  of  participating  students9  parents.  In  addition,  other  components  of  the  above 
surveys  provide  supplemental  details  concerning  language  minority  students,  gifted  and  talented 
students,  and  mathematics  and  science  curriculum. 

National  Opinion  Research  Center  (NORC)  is  joined  by  Westat,  Inc.  and  the 
Educational  Testing  Service  (ETS)  in  the  design  and  conduct  of  NELS:88.  Westat's 
responsibilities  focus  on  the  implementation  of  the  school  and  teacher  survey  components. 

This  section  of  the  Field  Test  report  provides  a  discussion  of  the  activities  related 
to  the  development  and  Field  Testing  of  the  School  Questionnaire  and  Teacher  Questionnaire. 
Relative  to  each  questionnaire,  this  discussion  presents  an  overview  of  the  questionnaire  design 
process,  purpose  and  content  of  each  questionnaire,  identification  of  the  respondent  samples  for 
the  questionnaires,  questionnaire  administration  procedures,  data  collection  procedures,  data 
processing  of  completed  questionnaires,  and  an  analysis  of  item  responses  and  nonresponse. 
Recommendations  that  should  be  considered  in  the  conduct  of  the  base  year  study  are  presented 
throughout  the  description  of  each  topic  detailed  below. 


ThU  chapter  wae  authored  by  Rocco  P.  Rumo,  Ph.D.,  and  Cindy  Gray  of  Wettat,  Inc.,  1650  Reeeerch  Boulevard, 
Rockville,  MD.  Editorial  aeeiftance  was  provided  by  Heather  Banki. 
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S.l  Design  of  the  School  and  Teacher  Questionnaires 

Westat  project  staff  initiated  work  on  the  development  of  the  school  and  teacher 
questionnaires  immediately  following  the  start-up  of  the  study  in  February  1986.  Content 
outlines  for  each  questionnaire  were  prepared  and  submitted  to  the  Center  for  Education 
Statistics  (CES)  for  wview  in  M?rch  1986  and  were  discussed  by  the  National  Advisory  Panel  in 
April  1986. 

The  school  questionnaire  outline  focused  on  gathering  general  descriptive 
information  about  the  educational  setting  or  environment  associated  with  the  individual  students 
who  have  been  selected  for  participation  in  NEL&88.  In  keeping  with  the  data  needs  targeted 
by  NEL&88,  emphasis  was  placed  on  gathering  longitudinal  data  that  would  be  useful  in 
explaining  future  outcomes  as  assessed  in  followup  survey  efforts.  Overall,  the  school 
description  is  intended  to  address  the  academic  climate  in  terms  of  items  such  as  enrollments 
and  educational  offerings  as  well  as  specific  school  policies.  Thus,  the  following  information 
areas  were  targeted  for  the  school  questionnaire: 

■  General  school  characteristics; 

s      Grading  and/or  testing  structure  used  by  the  school; 

■  Program  and  facilities  information; 

■  School  climate; 

■  Parent  interactions/involvement; 

■  Teaching  staff  characteristics;  and 
s       Respondent  data  for  followup. 

The  teacher  questionnaire  outline  stressed  the  acquisition  of  information  that  may 
help  account  for  the  sampled  students'  subsequent  development,  particularly  in  the  educational 
arena.  As  in  the  school  questionnaire,  emphasis  was  placed  on  meeting  the  longitudinal  student 
data  needs  targeted  by  NELS:88.  However,  data  which  could  be  used  in  cross-sectional  analyses 
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of  students'  educational  attainments  at  the  eighth  grade  level  were  also  considered.  The 
following  three  major  topic  areas  were  identified: 

■  Teacher  Impressions  of  Individual  Students  —  Specific  information  related  to 
the  teacher's  impressions  of  school-related  interests,  aptitudes,  and 
achievements  of  individual  students. 

■  Curriculum  Content  —  Data  about  the  name,  ability  track,  curriculum,  text, 
etc.,  for  each  course  currently  being  taught  by  the  teacher  to  one  or  more  of 
the  sampled  students. 

■  Teacher  Background  and  Activities  —  Geneial  information  about  the 
teacher's  demographics,  qualifications  and  experience,  current  caching  status, 
duties,  instructional  methods,  and  influence  over  school  and  classroom 
policies. 

Based  on  the  recommendations  provided  by  CES  staff  and  the  National  Advisory 
Panel  (NAP),  each  questionnaire  content  outline  was  revised  and  resubmitted  to  CES  in  May 
1986.  The  revised  content  outlines  provided  greater  detail  relative  to  specific  questionnaire 
items,  and  where  plausible,  suggested  item  stems  and  related  item  response  categories.  These 
expanded  content  outlines  were  discussed  at  the  second  National  Advisory  Panel  meeting  held  in 
June  1987.  As  a  result  of  these  discussions,  specific  guidelines  and  priorities  were  established 
and  were  utilized  in  the  development  of  draft  questionnaires. 

Westat  project  staff  developed  complete  drafts  of  the  school  and  teacher 
questionnaires  which  were  submitted  for  CES  review  on  June  27,  1987.  In  coordination  with 
the  CES  Interdivisional  Review  Committee,  CES  staff  identified  specific  recommendations  for 
revisions  of  the  draft  questionnaires  preparatory  to  submission  of  the  questionnaires  for 
clearance  by  FEDAC/OMB. 

Suggested  revisions  were  incorporated,  and  supporting  documentation  was  prepared 
for  consideration  by  FEDAC.  After  incorporating  revisions  suggested  by  FEDAC,  updated 
instruments  and  supporting  documentation  were  provided  to  OMB  for  consideration  on 
September  18,  1986.  Final  clearance  was  granted  by  OMB  on  December  8,  1986,  allowing  the 
school  and  teacher  questionnaires  to  be  formatted  and  printed  in  preparation  for  their 
administration  during  the  Field  Test. 
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5.2  Purpose  and  Content  of  the  School  and  Teacher  Questionnaires 

The  primary  purpose  of  the  Schoo!  Survey  is  to  identify  general  descriptive 
information  about  each  participating  eighth  grade  school  regarding  the  chool's  rtudent 
population,  teaching  staff,  policies,  program  offerings,  and  overall  educational  climate  as 
perceived  by  the  school  principal.  Information  obtained  through  tiie  administratis  of  this 
questionnaire  is  intended  to  assist  in  analyzing  the  learning  environment  and  experiences  of 
eighth  grade  students  and  to  assist  in  distinguishing  among  different  patterns  of  eighth  grade 
schools  and  the  effects  of  such  patterns  on  the  transition  of  students  to  the  tenth  grade  and 
beyond. 

The  school  questionnaire  is  designed  to  be  responded  to  primarily  by  the  school 
principal.  In  some  cases,  factual  data  may  be  provided  by  an  individual  who  extracts  such 
information  from  school  files  under  the  guidance  of  the  school  principal.  Directions 
accompanying  the  questionnaire  do  indicate  that  portions  of  the  questionnaire  request  factual 
data  that  may  not  be  readily  available  from  school  records.  In  such  cases,  informed  estimates 
are  acceptable  responses  to  such  questions.  Finally,  standard  assurances  of  confidentiality  and 
anonymity  are  provided. 

The  questionnaire  contains  the  following  eight  parts: 


Part  1  -  School  Characteristics  requests  general  information  about  the 
characteristics  of  the  participating  school  in  order  to  confirm  its  classification 
in  the  NEL&88  sample. 

Part  2  -  Student  Characteristics  seeks  information  about  the  general 
characteristics  of  the  school's  student  population. 

Part  „  -  Teaching  Staff  Characteristics  identifies  general  information  about 
the  professional  teaching  staff,  related  to  group  characteristics  and  operational 
organization  within  the  school. 

Part  4  -  School  Policies  and  Practices  requests  information  about  the 
operational  policies  and  practices  of  the  school. 

Part  5  -  Grading  and/or  Testing  Structure  seeks  "nformation  about  the 
grading  a)  J  testing  practices  of  .he  school. 
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■  Part  6  -  School  Programs  identifies  information  about  the  genera)  academic 
and  co-curricular  programs  that  are  available  to  eighth  grade  students 
enrolled  in  the  school. 

■  Part  7  -  School  Climate  identifies  the  overall  morale  and  attitude  of  the 
students  and  professional  staff  regarding  the  school  environment  as  perceived 
by  the  school  principal. 

■  Part  8  -  School-Parent  Interactions  collects  information  regarding  the  school's 
practices  designed  to  involve  parents  in  the  educational  process. 

Specific  items  contained  in  each  section  of  the  school  questionnaire  can  be 
identified  by  reviewing  a  copy  of  the  school  questionnaire  provided  in  Appendix  SA. 

The  primary  purpose  of  the  teacher  survey  is  to  link  information  regarding  specific 
teacher  characteristics  and  practices  to  information  about  the  characteristics  and  educational 
outcomes  of  the  participating  eighth  grade  students,  in  order  to  acquire  an  understanding  of  the 
effects  of  teaching  on  longitudinal  student  outcomes.  Thus,  data  are  collected  that  address 
teacher  qualifications,  specific  course  activities,  curriculum  exposure,  and  student-specific 
characteristics  is  judged  by  teachers.  The  overall  design  of  the  teacher  survey  reflects  the  four 
curriculum  areas  targeted  by  the  overall  goals  established  for  NELS:88.  These  areas  are: 
mathematics,  science,  English,  and  social  studies. 

The  teacher  questionnaire  is  designed  to  be  responded  to  by  teachers  of  the  sampled 
eighth  grade  students.  However,  it  is  important  to  note  that  the  teacher  survey  is  not  targeted 
at  acquiring  teacher-level  data.  Rather,  it  is  targeted  at  identify!.  ttudent-level  data  as 
reported  by  teachers,  pertaining  to  specific  eighth  grade  students  and  the  mathematics,  science, 
English,  and  social  studies  courses  in  which  they  are  enrolled.  Teachers  are  asked  to  respond  to 
the  questionnaire  items  relative  to  a  specific  list  of  sampled  eighth  grade  students  and  to 
designated  classes  in  which  the  sampled  students  are  enrolled.  The  standard  assurances  of 
confidentiality  and  anonymity  are  also  included. 

The  questionnaire  contains  three  distinct  sections: 


■  Part  I  -  Student  Information  asks  the  identified  teachers  to  indicate  which  of 
the  sampled  students  they  have  had  in  their  classes  during  the  current 
academic  year,  and  for  those  student*  enrolled  in  their  class(es),  to  evaluate 
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whether  or  not  the  student  has  had  various  school-related  problems  and 
handicaps. 

■  Part  II  -  Class  Information  requires  the  teacher  to  respond  to  a  series  of 
course-related  questions  regarding  a  distinct  set  of  classes  they  have  been 
identified  as  teaching  to  one  or  more  of  the  sampled  students.  Subsections  of 
items  within  this  segment  of  the  questionnaire  apply  to  the  four  specific 
curriculum  areas  (i.e.,  mathematics,  science,  English,  and  social  studies), 
enabling  teachers  to  respond  to  these  subsections  as  appropriate. 

■  Part  III  -  Teacher  Background  and  Activities  requests  teachers  to  provide 
general  background  information  about  themselves  and  their  school. 

Specific  items  contained  in  each  section  of  the  teacher  questionnaire  can  be 
identified  by  reviewing  a  copy  of  the  teacher  questionnaire  in  Appendix  5B. 

5.3  Respondent  Samples  for  the  School  and  Teacher  Questionnaires 

Identification  of  the  sample  of  respondents  for  the  school  questionnaire  was  quite 
straightforward,  following  the  identification  of  schools  involved  in  the  Field  Test.  Each 
principal  of  the  participating  schools  in  the  NEL&88  Field  Test  was  requested  to  respond  to  the 
school  questionnaire.  In  total,  51  school  questionnaires  were  administered,  and  46  completed 
questionnaires  were  returned,  resulting  in  a  90  percent  response  rate.  Of  the  remaining 
questionnaires,  three  principals  (6%)  refused  to  return  the  questionnaire,  and  two  principals  (4%) 
were  categorized  as  nonrespondents.  Additional  details  related  to  the  school  questionnaire 
response  rates  are  presented  later  in  this  chapter. 

In  comparison  to  the  schooi  questionnaire,  identification  of  the  sample  of 
respondents  for  the  teacher  questionnaire  proved  to  be  more  complicated.  The  design 
established  for  the  identification  of  teachers  was  based  on  the  need  to  obtain  information  about 
the  NELS:88  sample  students'  school-related  characteristics  and  experiences,  especially  those  that 
might  account  for  the  students'  educational  development.  The  teacher  survey  design  is  based 
upon  the  student  sample  and  the  four  pre-established  curriculum  areas  (i.e.,  mathematics, 
science,  English,  and  social  studies)  that  are  the  primary  focus  of  NEL&88.  At  each  school, 
approximately  30  students  were  sampled  for  participation  in  the  Field  Test.  To  achieve  the 
objective  of  "linking  information  from  the  teacher  to  data  about  individual  students  in  the 
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NEL&88  sample,"  two  teachers  were  identified  as  respondents  to  the  teacher  questionnaire  for 
each  student. 

Selection  of  respondents  to  the  teacher  questionnaire  for  each  student  is  based  on 
the  assignment  of  two  curricula  areas  per  school  included  in  the  Field  Test  sample.  Specifically, 
each  Field  Test  school  was  randomly  assigned  one  of  the  following  combinations  of  curriculum 
areas: 

■  Mathematics  and  English; 

■  Mathematics  and  Social  Studies; 

■  Science  and  English;  or 

■  Science  and  Social  Studies. 

Therefore,  at  any  given  school,  each  sampled  student's  current  teacher  in  each  of 
the  two  designated  curriculum  areas  was  selected  to  receive  a  teacher  questionnaire. 

This  selection  procedure  was  designed  to  assure  representation  of  Mathematics  or 
Science  curriculum  areas  and  also  of  English  or  Social  Studies  in  all  Field  Test  schools.  The 
curriculum  area  combinations  of  English  and  Social  Studies  as  well  as  Science  and  Mathematics 
were  not  components  of  the  design.  In  addition,  the  design  achieved  balanced  representation  of 
the  four  curriculum  area  combinations  across  th*  school  variables  of  control  (i.e.,  Catholic, 
Other  Private,  and  Public)  and  levjl  (i.e.,  Elementary,  Middle,  Junior-Senior  High  School).  To 
a  lesser  degree,  the  design  achieves  balance  across  the  five  states  covered  by  the  Field  Test 
sample. 

Finally,  using  this  design,  the  number  of  teacher-respondents  per  school  was 
expected  to  vary  depending  on  the  size  and  structure  of  the  eighth  grade  at  the  particular 
school.  It  was  anticipated  that  small  schools  with  self-contained  classes  at  the  eighth  grade  level 
could  have  as  few  as  one  or  two  applici^ie  teachers,  while  larger,  departmentalized  schools 
could  have  as  many  as  seven  to  ten  teacher- respondents. 

Implementation  of  the  teacher-respondent  selection  procedure  for  the  Field  Test, 
began  with  listing  the  52  sampled  schools  in  order  by  state  (i.e.,  CA,  FL,  IL,  NY,  and  TX) 
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within  level  within  control.  Next,  the  four  curriculum  area  combinations  were  ordered  in  a 
random  sequence  (i.e.,  1 -Mathematics  and  English,  2-Science  and  Social  Studies,  3-Mathematics 
and  Social  Studies,  and  4-Science  and  English)  and  a  random  start  combination  was  selected 
(i.e.,  combination  3-Mathematics  and  Social  Studies).  Beginning  by  assigning  the  start 
combination  to  the  first  school  in  the  ordered  listing  of  schools,  curriculum  areas  were  assigned 
to  schools  in  repeating  cycles  of  combinations,  3,  4,  1 ,  2. 

Table  5-1  presents  the  results  of  the  selection  procedure  on  a  school-by-school 
basis  as  well  as  overall  totals  by  control  and  level.  Overall,  each  curriculum  combination  was 
randomly  assigned  to  13  of  the  52  Field  Test  schools.  (As  noted  in  a  preceding  section,  a  final 
samp!*  ^f  51  schools  participated  in  the  Field  Test  following  substitution  procedures  for  refusal 
schools./ 

Following  the  selection  of  the  student  sample  in  a  given  Field  Test  school  and  the 
random  assignment  of  the  curriculum  combination  areas,  a  matrix  of  information  was  obtained 
from  school  records.  Exhibit  5-1  is  the  Class  Schedule  Matrix  used  in  the  teacher-respondent 
selection  process.  The  matrix  consisted  of  32  rows  (one  per  sampled  student)  and  two  columns 
(one  for  each  assigned  curriculum  area).  For  each  cell  in  the  matrix,  that  is,  for  each  student- 
curriculum  combination,  the  following  information  was  entered: 

■  Name  of  the  student's  current  teacher  in  that  subject; 

■  Weekly  schedule  for  the  class  (e.g.,  period  3); 

■  Unique  identifier  for  the  student-teacher-subject  combination  (e.g.,  M-l  for 
the  first  student's  current  math  class);  this  designation  would  be  used  for  all 
other  sampled  students  who  are  in  that  same  class-scheduled  combination;  and 

■  Course  title. 

Appendix  5C  provides  a  copy  of  the  detailed  instructions  used  by  the  school 
coordinators  to  complete  the  Class  Schedule  matrix.  An  assessment  of  the  problems  confronted 
in  the  completion  and  processing  of  this  matrix  is  presented  in  a  later  section  of  this  chapter. 
(See  Section  5.4.2). 
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Table  5-1 


NELS:88  Pretest:  Assignment  of  Schools  to  Curriculum  Area 
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Exhibit  5-1 


Class  Schedule  Matrix 
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Results  of  the  use  of  this  sampling  scheme  for  the  pretest  indicated  that  the  range 
of  the  number  of  teacher* respondents  per  sampled  school  was  1  to  IS,  with  an  average  number 
of  5.9  teacher- respondents  per  school. 

A  total  of  302  teachers  in  the  51  participating  Field  Test  schools  were  requested  to 
respond  to  the  teacher  questionnaire.  Of  these,  284  completed  and  returned  questionnaires  to 
Westat.  Of  the  remainder,  seven  teachers  (2%)  refused  to  return  the  questionnaire;  three 
teachers  (1%)  were  categorized  as  nonrespondents;  two  teachers  (1%)  were  no  longer  employed 
by  the  school;  and  six  teachers  (2%)  were  sampled  in  error.  Thus,  a  response  rate  of  96  percent 
(284/302-6)  was  achieved.  Additional  details  related  to  the  teacher  questionnaire  response  rates 
are  presented  later  in  this  chapter. 

5*4  Questionnaire  Administration  Procedures 

Following  the  printing  of  the  approved  school  and  teacher  questionnaires  for  the 
Field  Test  and  identifying  the  sample  of  respondents,  questionnaire  administration  procedures 
were  initiated.  Distribution  of  the  school  and  teacher  questionnaires  was  accomplished  by 
preparing  a  unique  "school  package"  for  each  participating  Field  Test  school.  Each  package 
contained  the  required  number  of  teacher  and  school  questionnaires,  related  cover  letters,  and 
instructional  materials  for  the  return  of  the  school  package  to  Westat. 

In  order  to  prepare  each  unique  school  package,  several  sources  of  pre-survey 
information  had  to  be  acquired  and  processed.  To  meet  the  study  objective  of  linking  school 
and  teacher  data  to  individual  students,  a  listing  of  school  questionnaire  respondents,  teacher- 
respc  >dents,  classes  attended  by  the  sampled  students,  etc.,  with  linkages  maintained  between 
data  sources*  was  required.  The  materials  needed  to  provide  this  pre-survey  information  were: 

■  A  Class  Schedule  form  completed  by  the  school  coordinator.  This  form 
identified  the  teachers  ana  classes  to  be  included  in  the  study.  This 
information  was  used  to  produce  the  teacher  labels  and  list  of  each  teacher's 
sampled  classes. 

■  School  file,  sent  on  computer  tape  from  NORC  to  Westat.  This  file  contained 
all  information  about  the  school,  including  ID  number,  name,  address, 
coordinator,  and  survey  date. 
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■  Student  file,  sent  on  computer  tape  from  NORC  10  Westat.    This  file 
contained  the  ID  numbers  and  names  of  the  sampled  students. 

■  Team  leader  information,  sent  to  Westat  by  NORC.     This  information 
included  team  leader  names  and  addresses,  and  school  assignments. 

The  administration  of  the  school  and  teacher  questionnaires  required  three  stages: 
collection  of  the  class  schedule  matrix,  collection  of  school,  student  and  team  leader  data,  and 
preparation  of  school  questionnaire  packages.  Each  stage  is  discussed  below. 


5.4.1  Collection  of  Class  Schedules 

Generating  a  list  of  teacher-respondents  and  list  of  classes  for  each  teacher- 
respondent  required  the  completion  and  return  of  the  Class  Schedule  matrix  by  the  school 
coordinator.  Once  NORC  had  completed  the  student  sampling  for  a  Field  test  school  (as 
described  in  Section  1.2.S),  the  school  coordinator  was  asked  to  complete  a  Class  Schedule 
matrix/form  (Exhibit  5-1).  On  this  form,  coordinators  recorded  information  about  classes  each 
sampled  student  attended  in  the  two  curriculum  areas  randomly  pre-assigned  to  the  school. 
Class  information  recorded  on  the  form  included:  period  or  hour,  course  title,  teacher  name, 
and  teacher  ID  number.  Detailed  instructions  provided  to  school  coordinators  are  contained  in 
Appendix  SC. 

The  Class  c~!.edule  serves  two  purposes.  The  first  purpose  is  to  identify  the 
teachers  who  teach  classes  in  the  designated  curriculum  areas  to  one  or  more  of  the  sampled 
students  included  in  the  study.  Each  teacher,  listed  at  the  bottom  of  the  Class  Schedule  by  the 
school  coordinator,  is  asked  to  complete  a  teacher  questionnaire. 

The  second  purpose  of  the  Class  Schedule  is  to  identify,  by  teacher,  the  specific 
class  each  student  attends  for  each  assigned  curriculum  area.  This  information  is  used  to 
produce,  for  each  teacher- respondent,  a  list  of  classes  for  which  the  teacher  is  asked  to  provide 
descriptive  information  in  Part  II  of  the  questionnaire. 
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The  Class  Schedule  also  provides  the  mechanism  to  link  teacher  ratings  of  students, 
and  descriptions  of  curriculum  and  practices,  to  individual  sampled  students.  The  materials  and 
procedures  used  to  generate  and  collect  Class  Schedules  are  discussed  in  the  following  sections. 

Materials 

In  November  1986,  Westat  submitted  a  draft  of  the  Class  Schedule  and 
accompanying  instructions  to  NORC  for  review.  After  some  revisions,  the  form  and 
instructions  were  approved  by  both  organizations.  Once  approved,  the  materials  were  finalized 
and  prepared  for  distribution  to  the  Field  Test  schools.  (See  Appendix  SC  for  copies  of  Class 
Schedule  and  instructions.)  After  mailing  the  first  Class  Schedule  package,  NORC  project  staff 
telephoned  the  school  coordinator  to  obtain  her  opinion  of  the  materials  and  solicit  suggestions 
for  improvement.  The  school  coordinator  indicated  that  she  understood  the  instructions  and  had 
no  difficulty  completing  the  Class  Schedule.  Therefore,  no  additional  changes  were  made  to  the 
materials. 

Each  Class  Schedule  package  included  the  following  materials: 

■  Cover  letter,  drafted  by  NORC,  explaining  the  purpose  of  the  study  and  the 
importance  of  the  Class  Schedule. 

■  The  Class  Schedule  form,  printed  on  oversize  (14  x  17  inch)  paper.  This  size 
allowed  coordinators  to  record  complete  class  information  on  a  single  page. 

■  Instructions  for  completion  of  the  Class  Schedule.  These  instructions  included 
illustrations  of  a  sample  Class  Schedule  at  each  stage  of  completion.  In 
addition,  directions  were  included  for  handling  unusual  situations,  such  as 
two  teachers  for  one  class. 

■  Roster  of  sampled  students  generated  by  NORC. 

The  Class  Schedule  package  materials  worked  quite  well.  However,  some  problems 
arose  which  should  be  addressed  before  materials  are  prepared  for  the  base  year  survey.  Ten 
school  coordinators  telephoned  NORC  with  questions  after  reviewing  the  materials.  In  addition, 
Westat  initiated  telephone  calls  to  nine  coordinators  to  clarify  Class  Schedule  information.  Most 
of  the  problems  which  necessitated  these  telephone  contacts  can  be  avoided  during  the  base  year 
by  making  some  simple  changes  to  the  materials. 
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One  of  the  main  problems  was  confusion  about  the  "Class  Number"  category  on  the 
Class  Schedule.  This  number  was  meant  to  be  a  unique  identifier  for  each  class,  used  in  the 
processing  of  data.  Several  coordinators  called  NORC  with  questions  about  the  class  number. 
In  addition,  only  eight  of  the  SI  schools  in  the  Field  Test  completed  the  class  number  column 
correctly.  Westat  staff  were  able  to  assign  corrected  class  numbers  based  on  the  period/hour 
and  teacher  information  supplied  by  the  school  coordinator.  Therefore,  we  propose  to  eliminate 
the  "class  number"  category  from  the  Class  Schedule;  instead,  class  numbers  will  be  assigned  by 
Westat  staff  during  the  processing  of  the  Class  Schedule. 

A  second  problem  occurred  in  schools  that  had  variable  schedules,  where  classes 
met  at  different  times  on  different  days.  For  this  situation,  coordinators  were  directed  to  write 
"none"  in  the  period/hour  column.  This  meant  that  we  could  not  differentiate  between  each 
teacher's  various  classes.  Therefore,  it  was  impossible  for  Westat  to  identify  the  list  of  classes 
about  which  each  teacher  was  to  provide  information  in  Part  II  of  the  teacher  questionnaire. 
This  problem  occurred  at  three  schools  all  located  in  New  York  State.  Westat  telephoned  each 
school  and  determined  that  eighth  grade  students  attended  classes  with  the  same  group  of 
students  all  day.  Therefore,  classes  could  be  differentiated  by  the  class  number  assigned  by  the 
school.  The  coordinators  gave  Westat  the  school  class  number  for  each  sampled  student.  These 
school  class  numbers  were  then  used  in  place  of  a  period/hour  number  to  identify  individual 
classes.  Thus,  we  propose  to  add  to  the  base  year  materials  instructions  for  handling  this 
situation.  Also,  the  instructions  will  be  changed  to  explain  more  fully  the  reasons  why  the 
detailed  class  information  is  needed. 

A  third  problem  occurred  in  schools  where  there  was  only  one  teacher  per  subject 
for  eighth  grade  students.  The  instructions  indicated  that  the  purpose  of  the  Class  Schedule  was 
to  identify  the  teacher-respondents  for  the  Teacher  Survey.  Therefore,  some  coordinators  felt 
that  they  only  needed  to  list  the  teachers  and  did  not  need  to  complete  the  entire  Class 
Schedule.  However,  if  each  tocher  taught  more  than  one  class  of  eighth  graders,  then  the 
specific  Class  Schedule  information  was  essential.  We  propose  altering  the  instructions  to 
explain  all  purposes  of  the  Class  Schedule. 
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Several  other  minor  problems  occurred  which  can  be  avoided  during  the  base  year 
by  clarifying  the  instructions  for  completing  the  Class  Schedule.  These  problems  are  discussed 
below: 

■  Some  sampled  students  left  the  school  between  the  time  period  when 
sampling  was  conducted  and  the  Class  Schedule  was  completed.  During  the 
Field  Test,  coordinators  who  telephoned  with  such  a  problem  were  instructed 
to  indicate  "withdrew"  on  the  Class  Schedule  for  these  students.  This 
instruction  will  be  added  to  the  base  year  materials. 

■  Some  students  attended  two  classes  in  the  same  subject  (e.g.,  grammar  and 
literature).  In  the  Field  Test,  coordinators  were  instructed  to  select  the  class 
that  involved  the  most  advanced  subject  matter.  Some  coordinators  did  not 
feel  that  one  class  ,  was  more  advanced  than  the  other.  If  such  situations 
occur  during  the  base  year,  NORC  or  Westat  will  randomly  select  one  of  the 
two  classes. 

■  Some  coordinators  reported  class  schedule  information  obtained  from 
planning  schedules  constructed  before  the  school  year  began,  although  the 
actual  schedules  were  quite  different.  During  the  base  year,  emphasis  will  be 
placed  on  obtaining  the  most  current  class  schedule. 

■  Including  the  school  telephone  number  on  the  Class  Schedule  for  the  base 
ysar  will  make  it  easier  to  contact  the  coordinator  for  clarification  without 
needing  to  cross-reference  survey  records. 

In  addition  to  the  above  problems,  others  resulted  from  coordinator  errors  in 
completing  the  Class  Schedules.  These  errors  were  judged  not  to  be  caused  by  problems  with 
the  materials.  Westat  expects  that  telephone  calls  to  a  small  number  of  coordinators  will  be 
needed  during  the  base  year  study  to  clarify  information  on  the  Class  Schedule  information. 


Procedures 

A  Class  Schedule  package  was  mailed  to  each  school  coordinator  by  NORC  after  the 
students  had  been  selected  and  a  sampled  student  roster  had  been  generated  for  the  school. 
Coordinators  returned  their  completed  forms  to  NORC  by  first  class  mail.  Once  a  copy  of  the 
completed  Class  Schedule  was  made  at  NORC,  the  original  was  sent  to  Westat  by  Federal 
Express. 
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The  first  Class  Schedule  package  was  mailed  December  16,  1936.  An  additional  18 
packages  were  sent  to  school  coordinators  during  December.  The  response  time  for  the  return 
of  these  forms  to  NORC  was  just  over  three  weeks  on  the  average.  This  response  time  was 
twice  as  long  as  the  later  average  because  of  the  winter  holidays. 

Eleven  packages  were  mailed  during  January  1987,  and  19  were  mailed  in  February. 
The  response  time  to  NORC  for  these  forms  was  an  average  of  8.4  business  days.  An  additional 
day  was  needed  to  return  the  forms  to  Westat.  The  remaining  two  schools  were  sent  packages 
by  Federal  Express  during  March.  These  two  schools  responded  in  five  days.  For  all  schools  in 
th£  Field  Test,  the  longest  response  time  was  24  days. 

If  a  Class  Schedule  was  not  returned  to  NORC  within  two  weeks,  a  prompting 
telephone  call  *vas  made  to  the  school  coordinator.  Four  coordinators  chose  to  complete  the 
form  during  the  telephone  call.  These  four  schools  had  small  class  sizes  and,  except  for  one 
school,  had  only  one  teacher  per  subject. 

When  a  Class  Schedule  was  received  at  NORC,  it  was  checked  for  completeness.  If 
any  crucial  items  were  missing,  the  coordinator  was  called.  There  were  never  any  serious 
problems  with  the  returned  forms.  Copies  were  made  of  the  forms,  and  the  originals  were  sent 
to  Westat. 

5.4.2         Collection  of  School  and  Student  Data 

School  and  student  files  were  sent  to  Westat  by  NORC  on  computer  tapes.  A  total 
of  six  tapes  were  sent  during  the  Field  Test.  Information  from  the  tapes  was  copied  onto 
Westat's  computer  system,  zrd  the  tapes  were  returned  to  NORC. 

School  data  were  sent  to  Westat  as  soon  as  a  school  had  agreed  to  participate  in  the 
study.  School  data  included:  ID  number,  school  name,  address,  telephone  number,  coordinator 
name  and  title,  scheduled  survey  date,  and  school  characteristics  (such  as  size  and  control).  This 
information  was  used  to  produce  coordinator  mailing  labels  and  to  ensure  that  materials  were 
sent  before  survey  day. 
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Student  data  were  sent  to  Westat  once  the  student  sampling  was  completed  for  a 
school.  These  data  included  sampled  students9  ID  numbers  and  names.  This  information  was 
used  to  produce  the  student  lists  included  in  each  teacher  questionnaire  package.  Teachers  used 
this  sampled  student  list  to  respond  to  Part  I  of  the  questionnaire. 

In  addition  to  school  and  student  data,  NORC  provided  We stat  with  a  lis'  of  team 
leader  names,  addresses,  and  school  assignments.  As  team  leader  assignments  changed,  NORC 
sent  updated  information  to  Westat  by  Federal  Express. 

5.4.3  Mailing  Preparations  for  School  Packages 

Once  all  of  the  pre-survey  materials  were  received  at  Westat  for  a  particular  school, 
a  questionnaire  package  was  prepared  for  that  school.  The  planned  data  collection  method 
(method  1)  involved  transmitting  a  o<"stionnaire  package  to  a  school  in  order  that  the  package 
would  arrive  at  least  two  weeks  prior  to  the  scheduled  survey  day.  This  allowed  time  for  the 
questionnaires  to  be  distributed  and  completed  before  survey  day.  Thus,  completed 
questionnaires  could  be  collected  by  the  NCRC  team  leader  on  survey  day.  During  the  Field 
Test,  23  schools  were  sent  packages  by  this  method. 

For  the  remaining  28  schools,  the  materials  .jquired  to  prepare  a  school  package  for 
mailout  were  not  received  two  weeks  before  survey  day.  Therefore,  an  alternative  data 
collection  method  (method  2)  was  used  with  these  schools.  This  second  method  invol.ed 
sending  a  questionnaire  package  to  the  NORC  team  leader  before  survey  day.  The  team  leader 
then  gave  the  package  to  the  school  coordinator  on  survey  day.  The  school  coordinator  was 
responsible  for  distributing  and  collecting  questionnaires,  and  mailing  the  completed  forms  to 
Westat. 

Data  collection  method  1  (sending  questionnaires  to  the  schools  two  weeks  before 
survey  day)  has  several  advantages  over  method  2: 

■  Th^re  is  more  incentive  for  teachers  and  principals  to  have  their 
questionnaires  completed  by  survey  day,  since  they  know  the  team  leader  will 
be  visiting  to  collect  the  forms. 
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i  Method  1  requires  a  shorter  data  collection  period.  Using  method  1, 
completed  questionnaires  are  expected  at  Westat  one  week  after  the  survey 
day.  Using  method  2,  completed  forms  are  not  expected  until  three  weeks 
after  the  survey  day  (two  weeks  are  needed  to  distribute,  complete,  and 
collect  forms;  one  week  is  needed  for  mailing  time). 

■  Method  1  eliminates  the  coordinator's  responsibility  of  mailing  questionnaires 
to  Westat.  During  the  Field  Test,  several  coordinators  who  were  called  for 
nonresponse  followup  said  that  the  questionnaires  were  completed  but  they 
either  "forgot"  to  mail  them,  or  thought  that  they  had  already  been  mailed. 

■  When  the  team  leader  collects  questionnaires  (using  method  1)  he/she  can 
ensure  that  every  form  is  accounted  for.  The  team  leader  can  make  \ure  that 
the  coordinator  understands  how  to  collect  and  return  any  forms  thai  are  not 
completed  by  survey  day.  llxis  procedure  helps  reduce  the  dumber  of 
followup  calls  needed  for  incomplete  packages  returned  to  Westat. 

The  importance  of  obtaining  a  completed  Class  Schedule  matrix  for  each 
participating  school  was  discussed  in  an  earlier  section  of  this  chapter  (see  section  5.4. 1).  The 
Class  Schedule  must  be'  received  and  processed  before  teacher  questionnaires  are  sent  to  the 
school  coordinator.  The  Class  Schedule  information  is  used  to  produce,  for  each  teacher- 
respondent,  a  list  of  classes  for  which  the  teacher  is  asked  to  provide  descriptive  information  in 
Part  II  of  the  questionnaire.  Therefore,  the  Class  Schedule  fulfills  two  main  purposes:  (1)  to 
identify,  by  teacher,  the  specific  class  er .  student  attends  for  each  of  the  curriculum  areas 
assigned  to  the  school,  md  (2)  to  link  teacher  ratings  of  students  and  descriptions  oi  curriculum 
and  practices  to  individual  sampled  students.  In  summary,  the  mechanism  for  linking 
descriptions  of  curriculum  and  practices  to  specific  students  would  be  lost  if  a  completed  Class 
Schedule  is  not  available  for  each  participating  school. 

Westat  and  NORC  are  discussing  ways  to  increase  the  use  of  method  1  during  the 
base  year  *udy.  The  main  reason  method  2  was  used  during  the  Field  Test  was  because  Class 
Schedules  were  received  at  Westat  less  than  two  weeks  before  survey  day.  For  the  method  2 
schools,  Class  Schedules  were  received  at  Westat  an  average  of  6.S  business  days  before  the 
scheduled  survey  day.  Data  collection  of  Class  Schedules  cannot  begin  until  the  student  sample 
has  been  drawn  at  NORC.  It  then  takes  an  average  of  just  under  two  weeks  to  collect  the  Class 
Schedules.  Therefore,  Westat  and  NORC  are  exploring  the  possibility  of  co~  ining  the  student 
sample  selection  and  collection  of  Class  Schedule  information.  One  strategy  for  accomplishing 
this  goal  would  be  to  have  NORC  field  staff  visit  each  school  to  draw  the  student  sample  on- 
site.  Once  the  sample  was  di_.,n,  the  school  coordinator  could  work  with  NORC  field  staff  to 
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complete  the  Class  Schedule  for  each  sampled  student.  This  procedure  would  reduce  the  pre- 
survey  data  collection  time  and  allow  the  school  and  teacher  survey  activities  to  begin  earlier. 

5.5  Data  Collection  Procedures 

Data  collection  includes  all  activities  associated  with  obtaining  completed  school  and 
teacher  questionnaires.  These  activities  include:  questionnaire  mailout,  receipt  control, 
nonresponse  followup,  and  data  retrieval  followup.  Each  activity  is  described  in  detail  in  the 
following  sections. 

5.5.1  Questionnaire  Mailout 

Once  a)!  of  the  pre-survey  materials  were  received  for  a  school,  the  appropriate 
mailing  method  was  r"  trmined,  based  on  the  survey  date  of  the  school.  Next,  mailing  labels, 
etc.,  were  produced  for  the  school,  and  questionnaire  packages  were  assembled.  Exhibir  5-2 
lists  the  mailout  materials  for  each  mailing  method.  Appendices  SD  and  SE  contain  copies  of 
the  materials  used  for  mailing  method  1  and  method  2,  respectively. 

As  discussed  in  Section  5.4.3,  two  methods  of  questionnaire  mailout  were  used 
during  the  Field  Test.  Method  I,  the  preferred  method,  involved  mailing  a  questionnaire 
package  to  school  coordinators  prior  to  the  scheduled  survey  day.  Completed  questionnaires 
were  then  collected  by  the  team  leader  on  survey  day.  Therefore,  with  method  1,  a  related 
package  was  mailed  to  the  team  leader,  containing  instructions  and  forms  needed  to  collect  the 
questionnaires  and  return  them  to  Westat.  Items  included  in  the  questionnaire  package  sent  to 
the  schoc1  coordinators  for  meth  >d  1  include  the  following: 

■  Coordinator  cover  letter, 

■  Principal  (school)  questionnaire  packet;  and 

■  Teacher  questionnaire  pcckets. 
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Exhibit  5-2 

NELS:88  Field  Test  School  and  Teacher  Questionnaire  Mailout  Materials 

Method  1  (If  one  and  1/2  weeks  or  more  before  survey  day) 
School  Package  (sent  to  School  Coordinator). 

1.  "Dear  NELS:88  School  Coordinator"  Cover  Letter 

2.  Principal  Packet  (inside  plain  envelope  with  principal  label) 

A.  "Dear  Principal"  Cover  Letter 

B.  Study  Brochure 

C.  Schr  ol  Questionnaire  with  School  ID# 

3.  Teacher  Packets  (inside  plain  envelope  with  teacher  name  label): 

A.  "Dear  Teacher"  Cover  Letter 

B.  Study  Brochu-e 

C.  Teacher  Questionnaire  with  Class  List  Label 

D.  Student  List  Inserted  ;n  Teacher  Questionnaire 

Team  Leader  Package: 

1.  "Deu     ELS:88  ""earn  Leader"  Cover  Letter 

2.  Co         Jear  NELS:88  School  Coordinator  Covt>r  Letter,  Stamped  as  Information 
Cop,  / 

3.  Instructions    for   Completion   of   NEL&88    Field    Test   School    and  Teacher 
Questionnaire  Transmittal  Form 

4.  Two  Copies  of  the  Transmittal  Form 

5.  Folded  TYVEK  Envelope  with  Business  Reply  Label 

6.  Five  Business  Reply  Labels 
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Exhibit  5*2  (continued) 
NELS:88  Field  Test  School  and  Teacher  Questionnaire  Mailout  Materials 


Method  2  (If  less  than  one  and  1/2  weeks  before  survey  day) 
Team  Leader  Package: 

1.  "Dew  NORC  Team  Leader"  Cover  Letter 

2.  Coordinator  Packet  (inside  plain  envelope  with  coordinator  label): 

A.  Instructions  to  School  Coordinators  for  Distribution  and  Return  of  NELS:88 
Field  Test  and  Teacher  Questionnaires 

B.  Two  Copies  of  the  Transmittal  Form 

C.  Folded  TYVEK  Envelope  with  Business  Reply  Envelope 

D.  Three  Business  Reply  Labels 

3.  Principal  Packet  (inside  plain  envelope  with  princioal  label): 

A.  "Dear  Principal"  Cover  Letter 

B.  Study  Brochure 

C     School  Questionnaire  with  School  ID# 

4.  Teacher  Packets  (inside  plain  envelope  with  teacher  name  label): 

A.  "Dear  Teacher"  Cover  Letter 

B.  Study  Brochure 

C.  Teacher  Questionnaire  with  Class  List  Label 

D.  Student  List  inserted  in  Teacher  Questionnaire 


271 


The  NORC  team  leader  package  for  mailout  method  1  included: 

■  Team  leader  cover  letter  and  instructions  for  collecting  completed 
questionnaires; 

■  Transmittal  forms  for  recording  the  status  of  each  questionnaire;  and 

■  Envelopes  and  labels  for  returning  questionnaires  to  Westat. 

The  second  mailout  method  was  used  when  materials  reeded  for  mailout  were  not 
obtained  two  weeks  before  survey  day.  This  method  involved  sending  all  materials  to  the 
NORC  team  leader,  who  then  gave  the  package  to  the  school  coordinator  on  survey  day.  The 
school  coordinator  was  responsible  for  distributing  and  collecting  questionnaires,  and  mailing 
comoleted  forms  to  Westat.  Items  in  the  questionnaire  package  sent  to  the  NORC  team  leader 
for  method  2  included: 

■  Team  leader  cover  letter; 

■  School  coordinator  packet  containing:  instructions  for  collection  of  completed 
questionnaires,  transmittal  forms  for  recording  the  status  of  each 
questionnaire,  and  envelopes  and  labels  for  returning  questionnaires  to  Westat; 

■  Principal  (school)  questionnaire  packet;  and 

■  Teacher  questionnaire  packets. 

5.5.2  Receipt  Control 

Records  of  all  data  collection  activities  were  maintained  in  a  computer-based 
receipt  control  system.  This  system  was  implemented  using  the  status  monitoring  system  (SMS) 
that  is  part  of  Westafs  Survey  Information  Svstem  (SIS).  SIS/SMS  is  implemented  in  the  C 
language  on  Westat's  VAX  computers  and  operates  very  efficiently  using  operating  system  calls 
for  indexed  file  processing.  The  receipt  control  system  has  full  security  features,  including 
optional  password  protection  of  fields  and  hidden  fields.  An  important  feature  of  SIS/SMS  is 
that  it  provides  an  integrated  interface  to  a  database  which  can  include  any  number  of  files. 
Therefore,  the  field  test  receipt  control  system  contained  two  files  within  the  same  database: 
the  school  file  containing  school-level  information  such  as  scheduled  survey  date  and  mailout 
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date;  and  the  questionnaire  file  containing  information  for  each  questionnaire,  such  as  date 
received  and  status  code.  A  description  of  the  receipt  control  fields  for  each  file  appears  in 
Appendix  5F. 

When  a  "package"  of  school  and  teacher  questionnaires  was  received  at  Westat,  the 
contents  were  reviewed  and  status  codes  were  assigned.  The  specific  procedures  followed  are 
listed  in  Exhibit  5-3.  Next,  the  date  received  and  status  codes  were  logged  in  the  receipt 
control  system.  The  questionnaires  were  then  filed  for  further  processing. 

In  addition  to  questionnaire  receipt,  the  receipt  control  system  was  used  to  record 
transmittals  to  and  from  the  telephone  center  and  data  entry.  Questionnaires  requiring 
nonresponse  or  data  retrieval  followup  wen,  logged  out  to  the  telephone  center  When  followup 
was  completed,  the  followup  status  was  logged  >  the  system.  When  a  batch  of  questionnaires 
was  ready  for  data  entry,  the  data  entry  batch  number  was  entered  in  the  receipt  control  system. 
Next,  a  batch  listing  was  run,  and  two  copies  of  the  listing  were  printed.  One  copy  of  the  list 
was  sent  with  the  cases  to  data  entry,  and  one  copy  was  retained  in  receipt  control. 

Each  week  during  the  data  collection  period,  a  status  report  was  produced  by 
Westat  and  sent  to  NORC.  This  report  reflected  the  status  of  school  and  teacher  questionnaire 
receipt  each  week.  The  final  status  of  questionnaire  receipt  by  control  of  school  appears  in 
Table  5-2.  In  general,  no  trends  in  "refusals"  or  "nonresponse"  were  noted  for  either  the  school 
or  teacher  questionnaire. 

5.5.3  Nonresponse  Followup 

The  three  types  of  followup  conducted  for  nonrespondent  school  and  teacher 
questionnaires  were:  telephone  calls  to  the  coordinator  when  no  package  was  received  from  a 
school,  telephone  calls  to  the  coordinator  when  an  incomplete  package  was  received,  and 
telephone  calls  to  principals  and  teachers  to  collect  questionnaire  information  by  phone.  Each 
of  these  types  of  followup  is  discussed  in  detail  in  the  following  sections. 

After  a  questionnaire  package  was  mailed  from  Westat,  the  expected  return  date 
was  determined  based  on  the  mailout  method  used.  An  expected  return  date  of  one  week  after 
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Exhibit  5-3 


NELS:88  Field  Test 
Package  Receipt  Instructions 


1.  Record  date  received  on  transmittal  form. 

2.  Check  transmittal  form  against  packets.    Make  any  necessary  changes  or  notes  on  the 
form  in  red  pencil. 

3.  Write  the  school  status  code  on  the  transmittal  form: 


CM  -  Complete,  all  forms  received 

PC  ■  Partial  Complete,  some  forms  received 

4.  Remove  questionnaires  from  envelopes  and  check  that  each  questionnaire  has  an  ID  label 
which  matches  the  envelope  label  (the  school  form  does  not  have  a  label  but  has  the  ID 
written  on  the  cover).  If  the  label  or  ID  is  missing  or  does  not  match,  keep  the 
questionnaire  with  the  envelope.  Keep  the  envelope  if  it  has  notes  on  it  written  by  the 
respondent.  Otherwise,  threw  away  the  empty  envelopes. 

5.  Write  the  questionnaire  status  code  on  each  questionnaire: 


CM  ■  Received  by  mail 
CT  -  Received  by  telephone 
RF  -  Refused 
OT  -  Other 

6.  Log  the  date  received  and  school  status  in  the  school  receipt  control  file.  Log  the  date 
received  and  questionnaire  status  in  the  questionnaire  file  for  each  form  received. 

7.  Put  the  questionnaires  and  transmittal  form  in  the  school  folder.  If  all  questionnaires 
were  received,  file  the  folder  in  the  drawer  for  "Complete  Packages."  If  some 
questionnaires  are  still  missing,  file  in  the  drawer  for  "Partial  Pa  kages.H 
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Table  5-2 

Questionnaire  Status  by  Control  of  School 


I  I                Control  of  School 

School  |  |  

Questionnaire          j  Total      |                  j  j 

StatUS               !  !     Public      I    Catholic     I  0ther 

I  I                  I                  I  Private 

 1  1  I  I  

Nonresponse   2  2 

Questionnaire  received   46  .             34                5  7 

Principal  refused   3                 2  1 

Total   51                 38                 6  7 


Teacher 
Questionnaire  | 
Status 

Total 

Control  of  School 

[  Public 

1  1 
j    Catholic  j 

1  1 

Other 
Private 

Nonresponse  

3 

3 

Questionnaire  received  

284 

254 

11 

19 

Teacher  refused  

7 

7 

Teacher  left  school  

2 

2 

Teacher  sampled  in  error  

6 

5 

1 

Total  

302 

~;i 

ll 

20 
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survey  day  was  used  for  schools  sent  questionnaires  by  ma  lout  method  1.  Mailout  method  1 
involved  sending  questionnaires  to  the  school  for  collection  by  the  team  leader  on  survey  day. 
Therefore,  one  week  was  allowed  for  the  team  leader  to  package  the  questionnaires  and  return 
them  to  Westat  by  first  class  mail.  For  schools  sent  questionnaires  by  mailout  method  2,  the 
expected  return  dace  was  three  weeks  after  survey  day.  For  this  mailout  method,  questionnaires 
were  sent  to  the  team  leader  who  gave  them  to  the  coordinator  on  survey  day.  Three  weeks 
allowed  the  coordinator  time  to  distribute,  collect,  and  mail  the  questionnaires  to  Westat. 

Of  the  SI  schools  in  the  Field  Test,  38  returned  packages  to  Westat  on  or  before  the 
expected  return  date.  Seven  schools  returned  packages  within  one  week  of  the  expected  return 
date.  For  the  remaining  six  schools,  prompting  telephone  calls  were  made  to  the  coordinators. 
Since  all  of  these  schools  had  been  sent  questionnaires  using  mailout  method  2,  the  coordinators 
were  responsible  for  sending  questionnaires  directly  to  Westat.  Five  of  the  six  schools 
responded  after  one  telephone  contact.  The  remaining  school  requite  J  two  telephone  contacts 
before  responding. 

The  second  type  of  nonresponse  followup  involved  telephone  calls  to  coordinators 
for  incomplete  packages.  Sixteen  incomplete  packages  were  received  at  Westat  during  the  Field 
Test.  When  an  incomplete  package  was  received,  the  transmittal  form  was  reviewed  to 
determine  what  followup  arrangements  had  been  made  by  the  coordinator  cr  team  leader  for 
return  of  the  nonrespondent  questionnaires.  If  questionnaires  were  not  received  at  Westat  by 
the  target  date  specified  on  the  transmittal  form,  a  followup  telephone  call  was  made  to  the 
school.  Of  the  16  incomplete  packages,  11  required  telephone  calls  to  the  coordinator. 

For  those  questionnaires  not  received  after  followup  telephone  calls  to  the 
coordinator,  the  principals  and  teachers  were  contacted  to  collect  questionnaire  data  by 
telephone.  These  contacts  were  made  to  eight  schools,  and  involved  five  school  questionnaires 
and  nine  teacher  questionnaires.  The  results  of  contacts  with  these  14  cases  were:  two 
questionnaires  were  completed,  eight  refused,  and  four  would  not  complete  questionnaires  by 
phone  but  promised  to  mail  them  (none  of  these  forms  was  received,  however).  This  followup 
effort  was  conducted  at  the  same  time  as  the  date  retrieval  followup  effort.  Therefore,  the 
training  procedures  are  describe  in  the  Data  Retrieval  Section  S.S.4. 
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5.5.4  Data  Retrieval  Followup 


If  a  school  or  teacher  questionnaire  contained  a  key  question  error  or  a  data 
consistency  error  that  related  to  a  key  question,  a  data  retrieval  telephone  call  was  made  to  the 
respondeat.  A  list  of  key  questions  for  each  questionnaire  type  appears  in  Exhibit  5-4.  When  a 
telephone  call  was  made  to  a  respondent,  all  errors  or  missing  data  on  the  questionnaire  were 
resolved.  Table  5-3  shows  the  number  of  data  retrieval  followup  cases  by  the  control  of  the 
school  (i.e.,  public,  Catholic,  and  other  private).  No  trends  were  noted  in  the  degree  of  data 
retrieval  followup  by  the  control  status  of  the  Field  Test  school.  However,  a  large  proportion  of 
teacher  questionnaires  required  data  retrieval  followup. 

The  main  data  retrieval  problem  was  discrepancies  between  Part  I  of  the  teacher 
questionnaire  and  the  Class  Schedule  completed  by  the  coordinator.  When  a  completed  teacher 
questionnaire  was  received  at  Westat,  the  answers  to  Part  I,  Question  1  were  compared  to  the 
Clasi  Schedule.  If  a  student  was  identified  on  the  Class  Schedule  as  assigned  to  a  particular 
teacher,  but  that  teacher  did  not  answer  "Yes"  for  that  student  in  Part  I,  Question  1,  then  the 
case  was  sent  to  data  retrieval  These  calls  determined  that  most  discrepancies  were  the  result 
of  errors  made  by  tha  teachers.  Some  teachers  interpreted  Question  1  to  include  only  students 
assigned  to  them  continuously  since  September,  instead  of  at  any  time  since  September. 
Recommended  changes  to  this  question  are  discussed  in  Section  5.7.2.  In  addition,  some 
teachers  scanned  the  list  of  student  names  quickly  and  skipped  some  students  they  should  have 
included.  A  possible  remedy  for  this  problem  would  be  to  include  the  two  teachers*  names 
supplied  by  die  coordinator  next  to  each  student's  rime  on  the  student  list  provided  to  the 
teacher  with  the  questionnaire. 

Before  data  retrieval  followup  began,  a  telephone  interviewer  manual  was  produced. 
(See  Appendix  5G.)  This  manual  included  general  instructions,  administrative  procedures,  and 
instructions  for  handling  specific  data  retrieval  items.  Telephone  interviewer  training  was 
conducted  on  April  13,  1987  and  interviewing  began  the  following  day.  Before  being  assigned 
to  the  NELS:88  Field  Test  project,  each  interviewer  had  to  complete  successfully  the  Westat 
general  interviewer  training.  This  training  consisted  of  audiovisual  presentations  and  a  written 
manual  on  general  telephone  interviewing  techniques  and  Telephone  Research  Center  (TRC) 
administrative  procedures.  The  training  session  for  the  Field  Test  was  conducted  using 
interactive  lectures  and  dyad  role  playing.    During  the  lecture  phase,  all  procedures  were 
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Exhibit  5-4 
NELS:88  Field  Test  Key  Questions 


School  Questionnaire 

Part  I:  P1Q1,  P1Q2,  P1Q3,  P1Q4,  P1Q5 

Part  2:  P2Q3,  P2Q4,  P2Q9,  P2Q10 

Part  3:  P3Q1,  P3Q2,  P3Q4,  P3Q5 

Part  4:  P4Q1,  P4Q8,  P4Q11 

Part  5:  P5Q1 

Part  6:  P6Q3,  P6Q4 

Part  8:  P8Q3 

Teacher  Questionnaire 

Part  t       For  all  students  P1Q1,  P1Q4,  P1Q6,  P1Q12 

Part  II       P2Q1,  P2Q2,  P2Q3,  P2Q4  P2Q5,  P2Q6,  P2Q12,  P2Q14,  P2Q16,  F2Q17,  P2Q20, 
P2Q21,  P2Q23 

Part  lit      P3Q1,  P3Q2,  P3Q4,  P3Q7,  P3Q9,  P3Q10,  P3Q11,  P3Q12,  P3Q13,  P3Q14,  P3Q15, 
P3Q20,  P3Q21 
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Table  5-3 

Data  Retrieval  Folbwup  Status  by  School  Control 


School 

1 

1 
1 
1 

Control  of  School 

questionnaire 
data  retrieval 
status 

I  Total 

j  Public 
1 

1  ! 
j    Catholic  j 

1  1 

Other 
Private 

Data  retrieval 
followup  required  

27 

23 

2 

2 

No  data  retrieval 
followup  required  

24 

15 

4 

5 

51 

38 

6 

7 

Teacher 

j                Control  of  School 

questionnaire 
data  retrieval 
status 

j  Total 

1  1  1 
j     Public      j    Catholic  j 

1                  1  1 

Other 
Private 

Data  retrieval 

followup  required   225  201  9  15 

No  data  retrieval 

followup  required   77  70  2  5 

Total   302  271  11  20 


EMC 


279 

341 


presented  and  questions  were  answered  as  they  arose.  After  the  lecture  was  completed,  role 
plays  were  conducted  in  pairs,  or  dyads.  Each  pair  of  trainees  completed  two  scripted 
interviews,  alternating  the  roles  of  interviewer  and  respondent.  The  respondent  was  given  a 
script  containing  answers  and  comments  to  be  used  for  each  questionnaire  item,  and  the  other 
trainee  acted  as  interviewer  and  completed  a  blank  script.  The  purpose  of  the  role  plays  was  to 
provide  additional  practice  with  the  questionnaire  and  allow  the  trainees  to  get  a  feel  for  the 
flow  of  the  interview  without  interruption.  Throughout  the  training,  emphasis  was  placed  on 
encouraging  respondent  cooperation.  Questions  that  the  respondent  might  ask  were  presented 
and  reviewed  along  with  the  possible  answers  to  such  questions. 

After  training,  interviewers  were  morJtored  by  TRC  supervisors.  In  addition,  each 
interviewees  completed  cases  were  carefully  reviewed.  Any  problems  were  discussed  with  the 
interviewers  and  corrected. 

5.6  Data  Processing  Completed  Questionnaire 

Data  preparation  and  processing  included  all  activities  associated  with  converting 
information  from  completed  school  and  teacher  questionnaires  to  clean  data  files.  These 
activities  included  manual  editing  and  coding,  data  entry,  and  machine  editing,  which  are 
discussed  in  the  following  sections. 

5.6.1  Manual  Editing  and  Coding 

This  operation  included  manual  editing  and  coding  of  both  school  and  teacher 
questionnaires.  The  purposes  of  the  editing  and  coding  operation  were: 

■  To  identify  questionnaires  needing  data  retrieval  and  prepare  them  for 
telephoning; 

■  To  identify  problem  situations  requiring  coding  decisions; 

■  To  review  competed  data  retrieval  cases,  recodir.g  as  necessary;  and 

■  To  prepare  all  questionnaires  for  data  entry. 
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The  first  step  in  performing  the  coding  operation  was  to  produce  coding  manuals 
for  each  questionnaire  type.  For  this  activity,  Westat  uses  a  proprietary  computer  software 
system  called  COED  ""odebooK  Editor).  The  COtu  *y»tem  can  format  and  print  a  coding 
manual,  and  produce  a  COBOL  machine  edit  program.  Both  of  these  functions  of  COED  use 
the  sane  input  file,  called  fhe  COED  source  file.  The  source  file  contains  information  on  all 
data  items,  including  variable  names,  column  numbers,  questions,  and  allowable  codes.  This  file 
is  created  at  the  beginning  of  the  study  and  is  updated  with  current  information  as  the  study 
progresses. 

The  first  product  derived  from  the  COED  system  is  a  coding  manual  in  a  printed, 
ladable  format.  The  coding  manual  is  the  document  that  contains  all  questions  and  allowable 
responses,  record  layout  information,  and  coding  information;  it  is  the  primary  guide  used  in 
the  coding  process.  In  addition,  ihe  coding  manual  contains  all  edit  instructions  for  the  manual 
edit/code  operation,  lite  coding  manual?  used  for  school  and  teacher  questionnaires  apped:  in 
Appendices  SH  and  SI,  respectively. 

The  second  COED  product  w  thf;  COBOL  edit  program.  This  program  "cleans"  the 
data  by  eliminating  errors  that  may  have  been  made  in  coding  or  data  entry  by  passing  the  data 
through  a  series  of  COBOL  if-then  statements.  This  machine  edit  system  is  discussed  in  Section 
5.6.3. 

Once  the  coding  manuals  had  been  developed,  separate  training  sessions  wre  held 
for  school  and  teacher  questionnaire  coding.  These  training  sessions  consisted  of  interactive 
lectures  and  coding  of  practice  questionnaires.  Practice  questionnaires  were  verified  by  the 
trainers  as  soon  as  tney  were  coded,  so  that  errors  could  be  discussed  and  corrected.  This 
technique  allowed  for  an  open  discussion  of  problem  areas,  and  enabled  trainers  to  clear  up 
areas  of  misunderstanding  and  to  identify  trainees  who  had  particular  -t  roblems. 

After  training,  the  coding  supervisor  verified  each  coder's  work.  /  Problems  or 
edit  errors  discovered  during  the  coding  operation  were  recorded  on  a  coding  problem  sheet 
(Exhibit  5-5)  which  was  then  attached  to  the  questionnaire.  The  three  types  of  problems 
discovered  during  coding  were:  respondent  errors  to  key  questions,  respondent  errors  to  non-Key 
questions,  anu  problem  situations  which  required  a  coding  decision. 
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Exhibit  5-5 
Coding  Problem  Sheet 


ID* 


Coder  initials: 


Date: 


Question  # 


Problem 


Explanation 


Resolution 


Question  # 


Explanation 
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If  a  questionnaire  contained  a  key  question  error  or  a  data  consistency  error  that 
related  to  a  key  question,  a  data  retrieval  call  was  made  to  the  school.  A  list  of  key  questions 
appears  in  Exhibit  5-4  in  Section  5.5.4.  When  a  call  was  made  to  a  school,  all  errors  or  missing 
data  on  the  form  were  resolved.  Therefore,  when  an  editor  determined  that  a  call  was  required, 
all  information  needed  for  key  and  non-key  questions  was  included  on  the  problem  sheet.  The 
data  retrieval  cases  were  then  sent  to  the  Telephone  Research  Center  to  be  resolved. 

If  a  questionnaire  contained  only  non-key  question  respondent  errors,  no  call  was 
made  to  the  school.  The  coding  supervisor  attempted  to  resolve  the  error  uing  information 
from  the  rest  of  the  questionnaire.  If  the  error  could  not  be  resolved  this  way,  then  the 
nonresponse  code  was  assigned. 

If  a  questionnaire  contained  a  problem  situation  requiring  a  coding  decision,  the 
case  was  referred  to  the  coding  supervisor.  When  a  problem  occurred  in  more  than  one  or  two 
cases,  instructions  on  how  to  handle  it  were  distributed  to  all  coders.  The  coding  supervisor 
explained  the  new  instructions  and  checked  that  each  coder  understood  them. 

5.6.2  Data  Entry 

Coded  questionnaires  were  transmitted  in  batches  to  Westat's  data  entry  facility. 
Questionnaires  were  keyed  to  disk  following  specifications  programmed  specifically  for  each 
type  of  questionnaire  (school  and  teacher).  These  specifications  included  all  skip  patterns  and 
zero-filling  of  numeric  fields.  Each  questionnaire  batch  was  100  percent  key  verified.  After 
verification,  each  batch  file  was  transmitted  to  Electronic  Data  Systems  (EDS)  where  the 
machine  xlit  programs  were  run. 

5.6.3  Machine  Editing 

The  purpose  of  the  machine  edit  operation  was  to  identify  and  correct  errors  on  the 
questionnaire  data  files.  The  types  of  errors  corrected  included  respondent  errors,  coding 
errors,  ind  data  entry  errors.   All  checks  made  during  manual  editing  were  also  made  during 
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machine  editing.  Thus,  any  errors  not  identified  manually  were  identified  by  computer.  The 
machine  edit  specifications  include  all  whecks  needed  to  identify  respondent,  coding  a.id  data 
entry  errors.  Separate  specifications  were  developed  for  each  questionnaire  type.  These 
specifications  appear  in  Appendices  SJ  and  SK.  The  types  of  checks  contained  in  the  edit 
specifications  are: 

■  Alpha  versus  numeric  This  edit  check  consists  of  checking  all  fields  in  the 
data  record  to  make  sure  that  pure  numeric  fields  contain  no  alphabetic  or 
special  characters. 

■  Ranqe  check:  These  edit  checks  verify  that  each  field  contains  only 
allowable  codes. 

■  Skip  pattern  check:  These  checks  verify  that  all  skip  instructions  on  the 
questionnaire  have  been  correctly  followed  by  the  respondent. 

r  Data  consistency  check:  These  checks  compare  data  in  different  fields  within 
*  record  to  ensure  that  consistent  answers  were  given  by  the  respondent. 

■  Addition  check:  This  type  of  check  is  used  to  verify  that  the  total  fields  are 
correct. 

As  discussed  in  Section  5.6.1,  the  Westat  COED  system  was  used  to  produce  the 
COBOL  machine  edit  programs.  All  range  and  skip  pattern  checks  were  generated  from  the 
same  source  files  used  to  produce  the  coding  manuals.  Next.  tL,  remaining  logic  checks  (for 
data  consistency  and  addition  errors^  were  added  to  the  logic  check  file.  The  COED  system 
then  translated  the  range  and  logic  checks  into  structured  COBOL  code.  Thus,  a  machine  edit 
program  was  produced  for  each  questionnaire  type  (school  and  teacher). 

When  each  questionnaire  batch  was  key  entered  and  transmitted  to  EDS,  the 
machine  edit  was  run  for  that  batch.  The  machine  editor  compared  the  error  listing  produced 
by  the  machine  edit  program  against  the  questionnaires,  lo  determine  how  to  resolve  the  edit 
errors  for  a  case,  the  editor  first  determined  whether  each  error  was: 

■  A  data  entry  or  coding  error; 

■  A  respondent  error  (including  missing  data)  to  a  key  question; 

■  A  respondent  error  (including  missing  data)  to  a  non-key  c;  jestion;  or 

■  A  problem  situation  requiring  an  editing  decision. 
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For  data  entry  and  coding  errors,  the  editor  obtained  trie  correct  data  from  the 
questionnaire  and  wrote  the  correction  on  an  update  sheet. 

Since  most  respondent  errors  and  problem  situations  wer*  identified  and  corrected 
during  the  manual  edit  operation,  only  a  few  of  these  errors  appeared  during  machine  editing. 
For  these  few  cases,  the  procedures  followed  were  *he  same  as  those  followed  during  the  coding 
operation  (as  discussed  in  Section  5.6.1).  When  the  correct  information  was  obtained,  the  editor 
wrote  the  correction  on  an  update  sheet. 

When  an  entire  batch  had  been  edited,  all  update  sheets  for  that  batch  were  keyed 
to  produce  an  update  file.  These  updates  were  then  made  to  the  batch  data  file,  and  a  new  was 
edit  run.  This  cycle  was  continued  until  all  errors  for  that  batch  were  resolved. 

5.7  Analysis  of  Questionnaire  Item  Responses  and  Nonresponse 

As  noted  -i  a  preceding  section,  the  overall  response  rates  achieved  for  the  School 
and  Teacher  Surveys  were  90  percent  end  96  percent,  respectively.  Although  these  rate«  are 
quite  acceptable,  several  suggestions  and,  jr  modifications  have  been  identified  that  would 
impiove  the  quality  of  the  information  acquired  through  the  survey  instruments. 

This  section  of  the  Field  Test  report  discusses  the  individual  item  responses,  or 
nonresponse  in  some  cases,  for  each  questionnaire.  Each  discussion  highlights  specific 
recommendations  that  should  be  considered  for  adoption  prior  to  initiating  the  base  year  study. 
A  discussion  of  the  school  questionnaire  is  presented  prior  to  a  discussion  of  the  teacher 
questionnaire. 

5.7.1  School  Questionnaire 

Overall,  data  collection  and  retrieval  procedures  related  to  the  school  questionnaire 
were  judged  to  be  successful.  In  total,  46  of  the  SI  questionnaires  distributed  were  completed 
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and  returned.  Of  the  remaining  five  questionnaires,  three  were  considered  refusals  and  two 
were  categorized  as  nonresponses. 

During  the  data  collection  stage,  the  Field  Test  "school  packages"  returned  to  Westat 
were  monitored  and  reviewed  for  completeness  in  terms  of  containing  the  expected  number  of 
school  -and  teacher  questionnaires.  When  a  school  package  was  delayed  or  determined  to  be 
incomplete,  the  school  questionnaire  was  often  the  cause  of  the  dela"  or  incomplete  status. 

The  delay  in  the  return  of  th3  school  questionnaire  is  reflective  of  the  inordinate 
amount  of  time  that  it  took  to  complete  the  questionnaire,  as  reported  by  school  principals.  As 
summarized  from  the  responses  to  Part  8,  Item  6  of  the  school  quejtionnaire,  the  average 
cumber  of  person-hours  required  to  complete  the  questionnaire  was  1  hour  and  36  minutes, 
with  a  range  of  20  minutes  to  5  hours. 

This  time  requirement  certainly  exceeded  project  staff  projections  and  suggests  that 
the  overall  length  of  the  questionnaire  should  be  shortened.  However,  specific  items  and/or 
sections  are  difficult  to  target  for  deletion  based  on  the  recommendations  made  by  CES  staff 
and  the  NAP  during  the  development  of  the  Field  Test  instrument  which  indicated  that  all 
information  requested  is  warranted.  Should  CES  staff  maintain  the  emphasis  on  staying  within 
an  estimated  response  burden  of  one  hour,  much  attention  to  reducing  the  length  of  the  school 
questionnaire  will  need  to  be  extended  by  CES  and  NAP.  One  suggestion  offered  is  to  reduce 
the  added  emphasis  placed  on  gifted  and  talented  programs  in  the  questionnaire  by  combining 
Part  6,  Item  3  and  Item  4  and  eliminating  Part  6,  Items  5,  6,  and  7.  Although  this  balances  the 
emphasis  placed  on  various  school  programs  addressed  in  the  school  questionnaire,  the  reduction 
in  completion  time  is  minimal.  In  the  event  that  the  questionnaire  is  not  significantly  reduced 
in  length,  we  would  recommend  that  a  more  accurate  estimate  of  the  time  required  to  complete 
the  questionnaire  be  convey  *d  to  principals  and  included  in  the  appropriate  backup  materials. 
In  addition,  a  higher  nonresponse  rate  should  be  expected  in  the  conduct  of  the  School  Survey 
for  the  base  year  study,  :equiring  project  staff  to  allocate  additional  iroject  resources  to 
nonresponse  followup  and  data  retrieval  efforts. 

The  percent  of  response  and  nonresponse  to  each  school  questionnaire  item  is 
presented  in  Table  5-4.  The  percentage  of  response  to  all  items  exceeded  90  percent  following 
all  followup  efforts.  Only  a  small  number  of  items  were  responded  tc  by  principals  as  "don't 
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Table  5-4 

Percent  of  Item  Response  end  Non response  for  the  School  Questionnaire 


Item     |    Responded     |    Refused     |    Don't  Know    |  Not         |  Total 

I  II  I      Ascertained  j 


•P1Q1  100%  100% 

•P102  100%  100% 

•P1Q3  100%  100% 

•P1Q4  100%  100% 

•P1Q5  100%  100% 

P1Q6  100%  100% 

P1Q7  100%  100% 

P1Q8  100%  100% 

r\Q9A  97.8%  2.2%  100% 

P1Q9B  97.8%  2.2%  100% 

P1Q9C  97.89f  2.2%  100% 

P1Q9D  97.8%  2.2%           .  100% 

P2Q1  100%  100% 

P2Q2  100%  100% 

•P2Q3  (A-E)       100%  100% 

•P2Q4  97.8%  2.2%  100% 

P2Q5  93.5%  6.5%  100% 

P2Q6A  100%  100% 

P2Q6B  100%  100% 

P2Q6C  97.8%  2.2%  100% 

P2Q6D  97.8%  2.2%  100% 

P2Q7  100%  100% 

P2Q8  100%  100% 

P2Q9  (A-D)  100%  100% 

•P2Q10  (A-H)      100%  100% 

•P3Q1  100%  100% 

•P3Q2  100%  100% 

•P3Q3  100%  100% 

•P3Q4  J  00%  100% 

•P3Q5  100%  100% 

P3Q6  97.8%  2.2%  100% 

P3Q7  100% 

P3Q8  (A-E)  100%  100% 

P3Q9  97.8%  2.2%  100% 

P3Q10  100%  100% 


*K«y  IUm 

*Numb«r  of  «cp«ct«d  tmpoium  par  it«m  v«ri«*  du«  to  ittm  pattern* 
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Table  5-4 


Percent  of  Item  Response  and  Nonresponse  for  the  School  Questionnaire  (continued) 


1 

1 

iiem  | 
1 

Kcsponoea 

1                                    1  1 
1                                    1  1 

1    Ketused     |    Don  t  Know  | 

1                 1  1 

i                 i  t 
t                 1  1 

1 

Not  | 

Ascertained  | 

■ 

i 

Total 

IUU% 

100% 

Pino 

P4Q3 

91.7% 

8.3% 

100% 

P4Q4 

91.7% 

8.3% 

100% 

1  AAA/ 

1  AAA/. 

100% 

IUV/% 

1  AAA/ 

100% 

1  A/MM, 

1  AAA/ 

100% 

1  AAA/. 

100% 

*  4v£r 

1  AAA/. 

100% 

P4Q10 

100% 

100% 

♦P4Q11 

.  100% 

100% 

1  AAA/ 

lp0% 

*PCA1  /A  n\ 

lUlno 

1  AAA/ 

100% 

P*fY>  /  A  n\ 
wyi  1 A -LI  J 

lAAGft 

100% 

PCAI 

1  W% 

1  A  A  AL 

100% 

IfWQt 

100% 

f  AAQC 

100% 

PW4  /A-F\ 

•  II/V7D 

1  AAA/ 

100^0 

1UU% 

1  AAA/. 
100% 

♦P6Q3 

100% 

100% 

♦P6Q4  (A-I) 

100% 

100% 

100% 

1 UU  70 

f  A-M 

1  WTO 

1  AAA/ 

1UU% 

P607  fA-n 

1  UUtD 

p^nt  /  a  a  Ci\ 

A  AOL 

4.4% 

1UU% 

ruyo        i> ,  OC 

P  O  R 

T&  U) 

97.8% 

2.2% 

100% 

P6Q8  (S) 

93.5% 

6.5% 

100% 

P7Q1  (A, 

L,  &0) 

97.8% 

2.2% 

100% 

P7Q1  (B-K, 

M  &  N) 

100% 

100% 

P7Q2  (A-L) 

100% 

100% 

P7Q3  (A-K) 

100% 

100% 

0 
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Table  5-4 

Percent  of  Itea  Response  and  Non response  for  the  School  Questionnaire1  (continued) 


I  I  I  I 


Item  | 
1 

• 

Responded 

t                   v^k         H                      1                    ft                                      *>A       WW  ft 

I    Refused     |   Don't  Know  | 

1  1  1 
1                 1  1 

Not  | 
Ascertained  j 
1 

Total 

P8Q1 

97,8% 

2.2% 

100% 

PoQ2  (A-H) 

100% 

100% 

AC  £OL 

95.0% 

2.2% 

2.2% 

100% 

PSQ4A 

100% 

100% 

PSQ4B 

97.8% 

2.2% 

100% 

P8Q4C(C, 

DAE) 

95.6% 

4.4% 

10091 

P8Q4  (F-I) 

97.8% 

2.2% 

100% 

PSQ4J 

100% 

•  100% 

?8Q4  (K-M) 

97.8% 

2.2% 

100% 

P8Q5A 

97.8% 

2.2% 

100% 

P8Q5B 

95.6% 

4.4% 

100% 

P8Q5  (C-K) 

97.8% 

2.2% 

100% 

P8Q5L 

95.6% 

4.4% 

100% 

P8QSM 

97.8% 

2.2% 

100% 

P8Q6 

97.8% 

2.2% 

100% 
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know/  or  were  coded  by  project  staff  as  "not  ascertained"  in  cases  where  non-key  items  were 
left  blank  by  respondents.  No  items  were  coded  as  "refusals."  It  should  be  noted  that  the 
percentages  reported  in  Table  5-4  are  based  on  the  number  of  expected  responses  for  an  item 
which  varies  due  to  item  skip  patterns. 


As  a  result  of  coding  and  editing  efforts  as  well  as  telephone  data  retrieval 
activities,  several  problem  items  were  noted.  Each  of  these  items  is  identified  and  discussed 
below. 


■  Part  1,  Question  5  —  The  "specialized"  response  category  was  not  utilized  by 
respondents.  We  would  recommend  keeping  this  response  category,  since  this 
result  is  likely  due  to  the  characteristics  of  the  Field  Test  school  sample. 

■  Part  1,  Question  9  —  45  respondents  identified  a  school  A,  24  respondents 
identified  a  school  B,  16  identified  a  school  C,  and  S  identified  a  school  D. 
However,  respondents  were  less  likely  to  record  information  about  the  "grade 
span"  and  "percentage  expected  to  attend"  relative  to  the  school  identified, 
since  in  large  cities  eighth  grade  students  branch  off  to  as  many  as  30 
different  schools.  We  would  recommend  eliminating  the  collection  of  "grade 
span"  and  "percentage  expected  to  attend"  information,  as  these  details  go  not 
offer  much  additional  assistance  in  tracking  the  eighth  grade  student 
longitudinally. 

■  Part  2,  Question  9  —  Two  specific  problems  were  noted  concerning  this  item. 
First,  about  20  percent  of  the  respondents  incorrectly  responded  to  Part  C  of 
this  item.  [That  is,  respondents  noted  that  academic  subjects  were  taught  in  a 
foreign  language  in  Part  C,  but  responded  "no"  to  all  academic  subjects  listed 
in  Part  D.]  During  data  retrieval  efforts,  project  staff  discovered  that  the 
information  provided  in  Part  C  indicated  that  the  school  offered  a  course  in 
Spanish,  French,  etc.,  rather  than  academic  subjects  taught  in  a  foreign 
language.  We  would  recommend  modifying  the  stem  to  Part  C  and  Part  D  in 
order  to  clarify  the  intent  of  this  questionnaire  item.  Part  C  could  be 
modified  as  follows: 

C.  Academic  subjects  (not  foreign  language  courses)  taught  in: 
Part  D  could  be  modified  as  follows: 

D.  Which  academic  subjects  are  taught  in  a  foreign  language? 

The  second  problem  that  was  identified  concerns  the  response  options  listed 
in  Part  C.  In  reviewing  the  responses  to  this  item,  the  only  response  options 
used  by  10  percent  or  more  of  the  respondents  were:  English,  Spanish,  and 
French.  We  would  recommend  modifying  the  response  options  to  Part  C  to 
include  the  following  reduced  list  of  options:  English,  Spanish,  French,  and 
Other  (Write  in). 


290 


Part  3.  Question  6  —  Only  10  percent  of  the  respondents  provided  a  "range" 
rather  than  the  "dollar  amount"  for  the  base  salary  for  a  beginning  teacher. 
We  would  recommend  that  this  questionnaire  item  be  simplified  by  requesting 
only  a  "dollar  amount." 

Part  4,  Question  1  —  Response  options  "4"  [achievement  criteria]  and  "5H 
[other  (specify)}  were  not  utilized  by  respondents.  We  do  not  recommend  any 
modifications  to  this  questionnaire  item,  since  this  finding  is  likely  to  be  due 
to  the  characteristics  of  the  Field  Test  school  sample. 

Part  5,  Question  1  —  42  respondents  identified  a  test  name  A,  17 
respondents  identified  a  test  name  B,  6  identified  a  test  name  C,  and  2 
identified  a  test  name  D.  However,  respondents  were  Sess  likely  to  record 
information  about  the  date  (i.e.,  month,  day,  and  year)  of  the  last 
administration  of  the  test.  Specifically,  the  "day"  the  test  was  administered 
was  the  most  problematic.  We  would  recommend  modifying  this  item  to 
request  the  date  of  administration  in  terms  of  month  and  year  only. 

In  several  cases,  respondents  indicated  a  test  that  would  be  administered  to 
students  at  the  "ninth"  grade  level.  Additional  review  of  these  responses  is 
required  in  order  to  determine  if  the  item  is  focused  correctly. 

Ia  addition,  coding  specifications  for  this  item  included  a  two-digit  code  that 
was  assigned  to  the  write-in  responses  to  "test  name."  In  review  of  the  codes 
utilized  relative  V  the  data  processing  of  this  questionnaire  item,  the  "Other" 
code  was  frequently  used.  We  propose  to  review  the  write-in  responses  in 
order  to  expand  the  standardized  codes  assigned  in  the  processing  of  this 
item. 

Finally,  the  format  of  this  item  should  be  modified  to  include  an  alpha- 
number  (i.e.,  A,  B,  C,  and  D)  for  each  of  the  possible  write-in  responses. 

Part  7,  Question  2  —  All  respondents  indicated  "yes"  to  the  existence  to  the 
following  sub-item:  "No-smoking  rules  prohibiting  smoking  by  students  in 
school  or  on  school  grounds."  We  would  recommend  that  this  sub-item  be 
dropped,  since  little,  if  any  variation,  in  responses  appears  to  exist. 

Part  8,  Question  2  --  All  respondents  indicated  "yes"  to  the  existence  of  the 
following  sub-items:  "Parents  are  given  interim  reports  during  the  grading 
period  if  grades  are  low,"  "Parent  conferences  are  scheduled  at  the  parent's 
request  to  discuss  student  behavior  and/or  performance/  and  "Parent 
conferences  are  scheduled  at  the  school's  request  to  discuss  student  behavior 
and/or  performance."  In  addition,  98  percent  of  all  respondents  indicated 
"yes"  to  the  existence  of  following  sub-item:  "Parent-school  associations  are 
encouraged  by  the  school."  We  would  recommend  timi  each  of  these  sub- 
items  be  dropped,  since  little,  if  any,  variation  in  responses  appears  to  exist. 

Part  8,  Question  4  and  Question  5  —  The  response  category  "No  action"  was 
not  used  by  any  of  the  respondents.   In  addition,  one  respondent  indicated 
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that  a  disciplinary  action  that  might  be  taken  is  to  transfer  the  student  to  an 
alternative  school  which  (s)he  felt  was  not  addressed  by  the  response  scale. 

We  would  propose  modifying  this  response  option  to  read  "No  action  or  warning 

issued." 

Project  staff  did  express  concern  that  respondents  might  not  realize  that  the  focus 
of  Part  8,  Question  4  was  related  to  "first  occurrence,"  while  the  focus  of  Part  8,  Question  5  w*a 
related  to  "repeated  occurrences."  Review  of  the  responses  to  these  questionnaire  items  did  note 
a  trend  for  increased  disciplinary  action  across  items.  However,  we  would  recommend  that  each 
focal  topic  (i.e.,  first  occurrence  or  repeated  occurrence)  be  emphasized  by  its  inclusion  in  the 
underlined  format,  in  the  item  stem. 

Lastly,  find  questionnaire  formatting  should  note  the  use  of  the  abbreviation 
"discipl."  for  the  word  disciplinary.  This  might  not  be  a  standard  form  of  abbreviation  and 
should  be  explained  in  the  stem  of  the  questionnaire  items. 

5.7.2  Teacher  Questionnaire 

In  general,  data  collection  an^  retrieval  procedures  related  to  the  teacher 
questionnaire  were  judged  to  be  successful.  In  total,  284  of  the  302  questionnaires  distributed 
were  completed  and  returned  to  Westat.  Of  the  remaining  18  questionnaires,  seven  were 
considered  refusals,  three  were  categorized  as  nonresponses,  two  were  not  returned  because  the 
teacher-respondent  left  the  sampled  school,  and  six  teacher-respondents  were  sampled  in  error 
by  the  school  coordinators.  Thus,  a  96  percent  response  rate  was  achieved. 

As  previously  discussed,  approximately  5.9  teacher  respondents  were  identified  per 
Field  Test  school.  On  the  average,  each  teacher  provided  ratings  for  10.S  students  in  Part  I  of 
the  questionnaire.  Only  IS  percent  of  the  teacher-respondenis  were  required  to  provide  ratings 
for  more  than  18  students.  However,  six  teacher- respondents  were  required  to  provided  ratings 
for  all  32  sampled  students  in  their  school. 
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In  Part  II  of  the  questionnaire,  an  average  of  2.8  clashes  were  described  by  each 
teacher- respondent.  In  total,  790  teacher-class  ratings  were  provided  by  the  284  teacher- 
respondents.  Of  this  total,  208  were  identified  as  English  teach  <- class  combinations,  207  were 
identified  as  science  teacher-class  combinations,  191  were  identified  as  social  studies  teacher- 
class  combinations,  and  184  were  identified  as  mathematics  teacher-class  combinations.  Table 
5-5,  provided  below,  presents  the  frequency  distribution  of  the  number  of  classes  rated  by  the 
teac  her-  respondents. 

Table  S-S. 

Number  of  Courses  RaM  bv  Teacher- Respondents 


Number  of  Course*           Number  of  Respondent*  Percent 

1  73  25.7 

2  69  24.3 

3  50  17.6 
<  46  •  16.2 

5  34  H.9 

6  11  3.9 
9  1  0.4 


284  100.0 

In  total,  12  teacher-respondents  (4.3  percent)  were  required  to  rate  more  than  five 
classes.  This  respondent  characteristic  necessitated  that  these  individuals  be  sent  a  second 
teacher  questionnaire  in  order  to  describe  each  of  their  classes  in  Part  II  of  the  questionnaire. 
This  alteration  in  administration  procedures  for  the  teacher  questionnaire  was  necessary  because 
the  item  formats  in  Part  II  allow  for  a  maximum  of  only  five  class  descriptions.  We  propose  no 
modification  to  the  formatting  of  Part  II  of  the  questionnaire,  since  this  finding  confirms  our 
earlier  belief  that  the  teacher-respondents  who  must  rate  more  than  five  classes  will  be  f  w  and 
exceptions  can  be  handled  on  an  individual  basis. 

The  percent  of  response  *nd  nonresponse  to  each  teacher  questionnaire  item 
following  followup  effort  is  presented  in  Table  5-6.  In  general,  the  percentage  of  response  to 
all  items  equaled  or  exceeded  90  percent.  Ten  items  yielded  lower  response  rates,  ranging  from 
83  percent  to  88  percent.  Teacher- respondents  infrequently  provided  a  "Don't  Know"  or 
-Refused"  response  to  items.  As  presented  in  Table  5-6,  a  very  low  percentage  of  questionnaire 
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Table  5-6 


Percent  of  Item  Response  and  Nonre«ponse  for  the  Teacher  Questionnaire 


Item 

1  1 
I    Responded  | 

i  i 

■  i 
1  1 

1 

Refused  | 

1 
1 

1 

Don't  Know  | 
1 

! 

Not  | 
Ascertained  j 

1 

Total 

riyi  (1-32; 

AO  AAL         1  AAAZ. 

98.9%  -  100% 

0%  -  1.1% 

100% 

P1Q2 

97.2% 

0.4% 

1.3% 

1.1% 

100% 

P1Q3 

98.1% 

0.4% 

0.5% 

1.0% 

100% 

98.3% 

f\  AtU 

0.4% 

0.4% 

0.9% 

100% 

niAr 

PlV}5 

Ail  *?fW. 

94.7% 

f\  AtU 

0.4% 

3.9% 

1.0% 

100% 

*P1Q6 

97.5% 

f\  AtU 

0.4% 

0.7% 

1.4% 

100% 

rlQ7 

A*7  (XCSL 

97.9% 

0.4% 

0.7% 

1.0% 

100% 

98.2% 

0.4% 

0.5% 

0.9% 

100% 

86.1% 

f\  AtU 

0.4% 

12.5% 

1.0% 

100% 

P1Q10 

88.7% 

0.4% 

9.8% 

1.1% 

100% 

D  1  f\  1  1 
Plljl  1 

95.9% 

0.4% 

2.5% 

1.2% 

100% 

Plv?12 

AC  ntkL 

95.7% 

0.4% 

2.2% 

1.7% 

100% 

Pzvjl 

1  AA/U. 

100% 

100% 

rZvJZ 

99.0 

1.0% 

100% 

AA  tQL 

99.7% 

0.3% 

100% 

AA  A  (\L 

99.4% 

0.6% 

100% 

rZV^j 

■  AAOL 
100% 

100% 

AO  1  OL 
98.1% 

0.6% 

1.3% 

100% 

pom 

AO  AOL 

1.6% 

100% 

rzv^oA 

AA  •  COL 

f\  e  (\J 

0.5% 

100% 

P2Q8B 

AA  CQL 

0.5% 

100% 

rzv^oc 

>iO% 

0.5% 

100% 

r  ZV/7 

AA  TQL 

yV.7% 

0.3% 

100% 

P2Q10 

AO  *QL 

Vo.3% 

1.7% 

100% 

pom  i  a 

0*7  "704. 

V7.7% 

2.3% 

100% 

rZKl  1  Id 

AT  AQL 

y /.o% 

:>.0% 

100% 

I  ^>V<  llv 

y  i  .0^0 

Z.ZTO 

100% 

P2Q11D 

97.0% 

3.0% 

100% 

♦P2Q12A 

97.8% 

1.2% 

1.0% 

100% 

♦P2Q12B 

97.8% 

1.2% 

1.0% 

100% 

♦P2Q12C 
♦P2Q12D 

97.8% 

1.2% 

1.0% 

100% 

97.8% 

1.2% 

1.0% 

100% 

♦P2Q12E 

57.8% 

1.2% 

1.0% 

100% 

♦P2Q12F 
♦P2Q12G 

97.8% 

1.2% 

1.0% 

100% 

97.7% 

1.1% 

1.1% 

100% 

P2Q13 

98.8% 

1.2% 

100% 

♦P2Q14 

98.6% 

1.4% 

100% 

Key  lUm 

1 
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Table  5-6 

Percent  of  Iter*  Response  and  Nonresponse  for  the  Teacher  Questionnaire1  (continued) 


Item     |  Responded 


~"Q15A  98.2% 

P2Q15B  97.0% 

P2Q15C  97.6% 

P2Q15D  97.6% 

P2Q15E  97.0% 

P2Q15F  97.6% 

P2Q15G  96.6% 

•P2Q16A  98.0% 

♦P2Q16B  99.5% 

♦P2Q16C  99.5% 

•P2Q16D  99.5% 

•P2Q16E  99.5% 

•P2Q17A  98.4% 

♦P2Q17B  98.4% 

•P2Q17C  98.4% 

•P2Q17D  98.4% 

•P2Q17E  98.4% 

•P2Q17F  98.4% 

•P2Q17G  98.4% 

•P2Q17H  97.3% 

♦P2Q17I  96.2% 

•P2Q17J  98.4% 

P2Q18  90  5% 

P2Q19  99.5% 

•P2Q20A  99.0% 

•P2Q20B  99.0% 

•P2Q20C  99.0% 

•P2Q20D  99.0% 

•P2Q20E  99.0% 

♦P2Q20F  99.0% 

•P2Q20G  99.0% 

'P2Q20H  99.0% 

*P2Q21  (A  -  D)  99  5% 

•P2Q2  E  98.6% 

*P2Q21  (F  -  L)  99.5% 
♦P2Q21  (M  &  N)  99.0% 

•P2Q210  98.6% 

♦P2Q21  (P  &  Q)  99.5% 


I  Refused  |  Don't  Knew 
I  I 

J  I  


0.4% 
0.4% 

0.3% 
0.3% 

0.4% 
0.4% 


1.1% 


I  Not         |        T  ial 

|      Ascertained  | 

J  L  


1.3% 

.00% 

2.6% 

100% 

2.0% 

100% 

2.1% 

100% 

2.7% 

100% 

2.0% 

100% 

3.0% 

100% 

2.0% 

100% 

0.5% 

100% 

0.5% 

100% 

Q.5% 

'00% 

0.5% 

ioo% 

1.6% 

;  ">o% 

1.6% 

100% 

1.6% 

100% 

1.6% 

100% 

1.6% 

100% 

1.6% 

100% 

1.6% 

100% 

1.6% 

100% 

3.8% 

1C  '« 

!.6% 

100% 

0.5% 

100% 

0.5% 

100% 

i  f\r\j 
1.0% 

100% 

1.0% 

100% 

1.0% 

100% 

1.0% 

100% 

1.0% 

100% 

1.0% 

100% 

1.0% 

100% 

1.0% 

100% 

0.5% 

100% 

1.4% 

100% 

0.5% 

100% 

'  ^% 

100% 

% 

100% 

0.5% 

100% 

9 
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Itkle  5-6 


Percent  of  Itrm  Response  and  Non  response  for  the  Teacher  Questionnaire1  (continued) 


1 

Item  | 
1 
1 

Responded 

1 

I  Refused 

1 

1 

1  1 
1    Don't  Know  1 

1  1 
i  i 

1 

Not  | 
Ascertained  | 

1 

Tntal 

P2Q22 

99.0% 

1.0% 

100% 

•P2Q23 

99.5% 

0.5% 

100% 

P2Q24A 

99.5% 

0.5% 

100% 

P2Q24B 

92.3% 

7.7% 

100% 

P2Q25 

99.5% 

0.5% 

100% 

P2Q26 

99.5% 

0.5% 

100% 

*P3Q1 

100% 

100% 

*P3Q2 

98.2% 

0.4% 

1.4% 

100% 

P3Q3 

95.4% 

1.1% 

0.4% 

3.1% 

100% 

*P3Q4 

98.9% 

1.1% 

inn% 

P3Q5 

99.3% 

0.7% 

100% 

P3Q6  (A  -  D) 

99.3% 

0.7% 

100% 

*P3Q7 

98.9% 

1.1% 

100% 

P3Q8  (A  -  F) 

98.2% 

1.8% 

100% 

*P3Q9 

97.1% 

1.1% 

0.4% 

1.4% 

100% 

*P3QI0A 

98.2% 

0.4% 

1.4% 

100% 

*P3Q10C 

95.3% 

1.4% 

0.5% 

2.8% 

100% 

P3Q1 1 

98.2% 

1.8% 

100% 

*P3QI2 

98.6% 

1.4% 

100% 

*P3Q13  (A  -  L) 

92.5% 

7.5% 

100% 

'P3QI4 

92.5% 

7.5% 

100% 

'P3QI5  (A  -  D) 

92.5% 

7.5% 

100% 

P3Q1*  (A  -  E) 

92.5% 

7.5% 

100% 

P3VJ17 

99.3% 

0.7% 

100% 

niAt  O 

P3VJlo 

97.5% 

2.5% 

100% 

P3QI9  (A  -  F) 

98.2% 

1.8% 

100% 

*P3y2U  (A  -  C) 

97.2% 

2.8% 

100% 

'P3Q2I 

98.2% 

1.8% 

100% 

P3y22 

/\A\  /\A/ 

90.0% 

10.0% 

100% 

10.0% 

100% 

P3Q24 

90.0% 

10.0% 

100% 

P3Q25  (A  -  D) 

88.0% 

12  0% 

100% 

P3Q25  (E  &  F) 

86.0% 

14.0% 

100% 

P3Q26  (A  -  C) 

90.0% 

10.0% 

100% 

P3Q26  (D  -  F) 

88.0% 

2.0% 

10  1% 

100% 

P3Q26  (G  &  H) 

86.0% 

2.0% 

12.0% 

100% 

P3Q26I 

88.0% 

2.0% 

10.0% 

100% 

P3Q26J 

90.0% 

10.0% 

100% 

P3Q26K 

83.0% 

12.0% 

100% 
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Table  5-6 

Percent  of  Item  Response  cod  Nonresponse  for  the  Teacher  Questionnaire1  (continued) 


i  i  I  I  I 

Item     |    Responded     |    Refused     |    Don't  Know    |  Not         |        To  al 

I  II  |      Ascertained  | 


P3Q27 

98.9% 

1.1% 

100% 

P3Q28 

98.2% 

0.4% 

1.4% 

100% 

P3Q29 

98.2% 

0.7% 

1.1% 

100% 

P3Q30A 

98.6% 

1.4% 

100% 

P3Q30B 

98.9% 

1.1% 

100% 

P3Q30C 

97.5% 

0.4% 

2.1% 

100% 

P3Q30D 

98.2% 

0.4% 

1.4% 

100% 

P3Q30- 

97.2% 

0.4% 

0.4% 

2.0% 

100% 

P3Q30F 

98.2% 

0.4% 

1.4% 

100% 

P3Q30G 

98.2% 

1.8% 

100% 

P3Q30H 

98.2% 

0.7% 

1.1% 

100% 

P3Q31 

99.3% 

0.7% 

100% 

P3Q32 

96.8% 

0.4% 

0.4% 

2.4% 

100% 

P3Q33 

84.7% 

1.7% 

13.6% 

100% 

P3Q34 

83.0% 

1.7% 

1.7% 

13.6% 

lu0% 
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responses  were  coded  "Not  Ascertained"  by  project  staff  in  cases  where  items  were  left  blank  by 
respondents  and  followup  efforts  were  not  warranted  or  achieved,  it  should  be  noted  that  the 
percentages  reported  in  Table  5-6  are  based  on  the  number  of  expected  responses  for  an  item 
which  varies  dur  to  item  skip  patterns. 

Item  jnresponse  followup  efforts  were  required  for  225  questionnaires  or  74.5 
percent.  In  part,  this  high  percentage  of  followup  effort  was  due  to  the  amount  cf  time  that  it 
took  to  complete  the  questionnaire,  as  reported  by  teacher-respondents.  As  summarized  from 
the  responses  to  Part  III,  Item  33  of  the  teacher  questionnaire,  the  average  number  of  person- 
hours  required  to  complete  the  questionnaire  was  1  hour  and  9  minutes,  with  a  range  of  10 
minutes  to  5  hours. 

This  time  requirement  was  IS  percent  over  the  one  hour  response  burden  target 
established  for  the  *;acher  questionnaire.  The  additional  time  requirements  mav  be  accounted 
for  by  the  added  questions  related  to  the  topics  of  "teacher-respondent  proficiency  in  languages 
other  than  English,"  and  "teacher  and  program  characteristics  for  gifted  and  talented  school 
programs."  Approximately  17  percent  of  the  respondents  were  required  to  respond  to  the  subset 
of  items  addressing  non-English  language  proficiency  (Part  III,  Items  12,  13,  14,  IS  and  16), 
while  roughly  16  percent  of  the  teacher-respondents  were  required  to  respond  to  the  subset  of 
items  addressing  "gifted  and  talented  programs"  (Part  III,  Items  21,  22,  23,  24,  25,  and  26).  As 
a  resu*.,  a  higher  followup  rate  should  be  expected  in  the  conduct  of  the  Teacher  Survey  for  the 
bziJ  year  study,  requiring  project  staff  to  allocate  additional  project  resources  to  followup  and 
data  retrieval  efforts. 

A  second  factor  relative  to  the  high  followup  effort  relates  to  discrepancies  noted 
during  the  editing  of  return  questionnaires.  The  editing  process  discovered  apparent  confusions 
in  responses  indicating  that  a  teacher- respondent  did  not  have  one  or  mor  of  tM  sampled 
students  assigned  to  his/her  class  while  the  field  test  school  indicated  that  the  sampled  student 
was  assigned  to  the  teacher's  class.  This  problem  has  been  discussed  in  a  preceding  section  of 
this  report,  Section  S.S.4.  A  related  issue  stemming  from  the  data  editing  specifications, 
suggests  that  there  rmp!y  may  be  too  many  items  that  have  been  identified  as  "key"  items. 
Project  staff  should  review  the  edit  specifications  to  determine  if  alterations  are  /arranted, 
thereby  reducing  the  volume  of  data  retrieval  required  for  the  base  year  study. 
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As  a  result  of  coding  and  editing  efforts  as  well  as  telephone  data  retrieval 
activities,  several  problem  items  were  noted.  Each  of  these  items  is  identified  and  discussed 
below. 

■       Printing  Errors: 

( 1 )  The  OMB  number  printed  on  the  questionnaire  was  incorrect. 
Computer  printed  labels  bearing  the  correct  number  were  added  to  the 
questionnaires  prior  to  distribution. 

(2)  The  instructions  to  Part  I  read  "Questions  2-10  apply  only  to  students 
whom...."  and  should  be  corrected  to  read  "Questions  2-12  apply  only 
to  students  whom  ...." 


(3)  .he  student  matrix  printed  for  Part  I  (pages  1  and  2),  incorrectly 
numbered  thi  response  options  for  student  #30.  The  item  should  be 
corrected  to  ensure  the  following  order  "Yes  (1),"  "No  (2),"  and  "DK 
(8)." 

(4)  Part  II,  Question  6  reads  "(See  back  cover  for  definition)."  The  final 
.instrument  for  the  base  year  study  should  delete  this  reference. 

(5)  Part  III,  Question  20  contains  numeric  codes  ("2")  to  the  left  of  each 
response  box.  Each  code  should  be  deleted. 

(6)  Part  III,  Question  21  contains  an  incorrect  skip  pattern  reference.  Skip 
pattern  should  read  "(Skip  to  Q.26)"  nther  than  "(Skip  to  Q.27)." 

(7)  Part  III,  Question  26  the  item  statement  reading  "Student  use  alcohol" 
should  read  "Student  use  of  alcohol." 

(8)  Part  III,  Question  28  the  period  (.)  in  the  first  response  opuon  should 
be  deleted  to  read  "No  days  absent." 

(9)  Part  III,  Question  30  the  response  ?cale  should  be  corrected  to  delete 
the  plus  sign  (+)  after  the  option  5  hrs. 


Part  I,  Question  1  —  The  wording  of  this  item  stem  has  caused  confusion  for 
some  teacher-respondents.  Respondents  who  started  teaching  later  in  the 
school  year  or  who  may  have  had  the  studtit  for  a  one-semester  course  are 
uncertain  how  to  respond  due  to  the  Septeiu'*er  1986  reference  in  the  item 
stem.  In  addition,  other  teachers  have  expre*s<*d  uncertainty  about  how  to 
respond  in  cases  where  students  may  have  dropped  out  of  their  class  mid- 
year or  mid-term.  Finally,  some  teacher-respjndents  firmly  indicated  that 
they  did  not  h<tve  one  or  more  student*  assigned  to  their  classes  yet  the 
school  maintained  that  the  assignment  was  correct. 

We  would  recommend  rewording  the  item  stem  to  Question  1  to  read  "Has 
this  student  been  assigned  to  one  or  more  of  your  cl?  s  during  the  1988-89 
school  year?" 
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One  additional  problem  that  arose  during  the  field  test  concerned  the 
sampling  of  more  than  32  students  in  participating  rchools.  In  such  cases, 
teacher-respondent  ratings  were  limited  to  32  students  due  to  the  matrix 
format  for  Part  I  of  the  questionnaire.  Prior  to  finalizing  this  questionnaire 
for  the  base  year  study,  project  staff  should  identify  an  upper  limit  for  the 
number  of  students  sampled  per  school  or  determine  whether  exceptions  will 
be  handled  by  altering  the  questionnaire  or  its  administration  procedures. 

Part  II,  Quv.  )n  1  --  During  editing,  project  staff  were  often  unable  to 
determine  if  the  order  in  which  teacher- respondents  listed  classes  for  Part  II 
of  the  questionnaire  coincided  with  the  designated  list  provided  on  the  face 
of  the  questionnaire.  To  simplify  editing  efforts,  we  would  recommend  the 
following  modifications:  (1)  instructions  to  Par.  II  should  state  that  the 
respondent  list  classes,  by  title  and  period,  following  the  same  order  as  the 
list  provided  on  the  face  of  the  questionnaire,  (2)  the  write-in  format  should 

include  a  space  for  title  and  period  (e.g.,  Title    Period  # 

 ___),  and  (3)  the  computer  list  oT  classes  provided  on  the  face  of 

the  questionnaire  should  be  sorted  by  class  period  in  ascending  order 

Part  II,  Question  9  —  Many  respondents,  mostly  English  teacher  respondents, 
provided  more  than  one  textbook  title.  In  addition,  respondents  were  ler 
likely  to  record  information  about  the  publication  date  and  edition  number. 
We  would  recommend  that  "eiimaEX"  be  emphasized  in  this  item  stem  by 
underlining  the  word. 

Part  II,  Question  17a- 17j  «  Uss  than  four  percent  of  the  applicable  teacher- 
respondents  used  the  "Not  Covered"  response  options  for  these  items.  We 
propose  no  changes  to  this  response  scale.  However,  the  mathematics  topics 
listed  in  this  item  stem  may  be  too  general.  This  topic  will  be  explored  with 
the  mathematics  subject  matter  experts  on  the  NAP. 

Part  II,  Question  19  --  Less  than  three  percent  of  the  applicable  teacher- 
respondents  used  the  "Every  Day"  response  option.  We  would  recommend 
modifying  this  item  response  scale  as  follows:  Several  times  a  week  or  more 
(1),  About  once  a  week  (2),  and  Hardly  ever  or  never  (3). 

Part  II,  Question  25  —  The  form.t  of  this  item  should  be  modified  to 
maintain  format  consistency  throughout  the  questionnaire.  Each  of  the  item 
statements,  numbered  one  through  four,  should  be  listed  inside  all  five  "class" 
response  blocks. 

Part  III,  Question  6a-6d  —  In  total,  approximately  five  percent  or  less  of  the 
teacher- respondents  used  the  "Provisional,  probationary,  or  temporary"  and 
"Emergency"  response  optiens.  In  addition,  62  percent  to  73  pe4  mt  of  the 
respondents  used  the  "No  certification  in  this  area"  response  option.  These 
findings  suggest  that  the  i'em  stem  should  be  expanded  to  include  an  item 
statement  "6e.  Other"  or  that  certificates  are  not  described  in  terms  of 
subjects,  but  by  other  categories  (e.g.,  grade  levels).  Should  the  latter  be 
true,  the  item  stem  should  be  modified  to  reflect  the  appropriate  descriptor. 
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■  Part  HI,  Question  7  —  No  respondents  utilized  the  "High  school  diploma"  or 
"Associate  degree/ vocational  certification"  response  options.  We  would 
recommend  combining  these  response  options  into  one  which  reads  "Less  than 
a  bachelor's  degree." 

■  Part  HI,  Question  8  —  Respondents  provided  majors  and  minors  for  more 
than  one  degree.  We  would  recommend  emphasizing  rhighest"  by  underlying 
the  word. 

■  Part  III,  Question  13  —  The  response  options  of  "Japanese,"  "Korean,"  and 
Portuguese"  were  not  used  by  ar  /  of  the  applicable  teacher- respondents.  In 
addition,  the  response  options  ot  "Italian,"  "Greek,"  "Any  Filipino  language," 
and  "Polish"  were  used  by  less  than  five  percent  of  the  u.^ondents.  We 
would  recommend  modifying  the  item  stem  to  include  the  following  item 
statements  only:  (a)  Spanish,  ( i)  French,  (c)  German,  and  (d)  Other. 

■  Part  III,  Question  15a- 15d  ~  Overall,  the  response  option  "Not  at  all"  was 
used  by  only  on*  applicable  teacher-respondent  for  only  one  item  statement. 
We  would  recommend  changing  the  response  options  to  "Excellent,"  "Good," 
"Fair,"  and  "Poor." 

■  Part  III,  Question  19  —  Although  no  response  problems  were  noted,  we 
would  recommend  adding  the  following  phrase  to  this  item  stem,  "...  in- 
service  education  in  the  subject  you  teach  the  majority  of  the  time,  have 
you...".  This  modification  would  maintain  consistency  in  response  between 
Questions  \i  and  19. 

■  Part  III,  Question  20  —  Data  retrieval  staff  indicated  that  some  teacher- 
respondents  replied  to  this  item  in  reference  to  the  classes  listed  ca  the  face 
of  the  questionnaire.  We  would  recommend  modifying  the  itam  statements 
numbered  (a)  and  (b)  to  include  the  word  "total"  (i.e.,  "Total  number  of  ). 

In  addition,  the  item  should  include  a  "CIRCLE  ONE"  statement  above  the 
numbered  response  options.  Therefore,  the  word  "check"  in  the  item  stem 
should  be  changed  to  "indicate." 

Even  with  these  changes,  we  believe  that  this  question  provides  ambiguous 
information.  The  respondent's  point  of  reference  to  item  statements 
numbered  (a),  (b),  and/or  (c)  is  never  established.  Do  these  responses  address 
ODjy  the  mathematics,  science,  English  and/or  social  studies  classes  taught  by 
the  respondent  or  all  classes  (e.g.,  driver  education,  music,  etc.)?  We  would 
recommend  that  this  'tern  be  dropped  or  rewritten  into  several  different 
items. 

■  Part  III,  Question  26  •  -  Each  item  statement  should  be  numbered  (a)  through 

(k). 

■  Part  III,  Question  28  --  Less  than  two  percent  of  the  teacher- respondents 
used  the  response  options  "12-15  days  absent,"  "16-20  days  absent,"  "21-29 
days  absent,"  and  "30  or  more  d  ys  absent."   We  would  recommend  deleting 
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these  response  options  and  modifying  the  last  option  to  read  "12  or  more  days 
absent." 


■  Part  III,  Question  30  —  Although  no  problems  were  noted,  we  would 
recommend  editing  the  iteir  stem  to  read  "How  much  time  do  you  spend 
OUlSidfi  your  regular  school  hours  on  each  of  the  following  activities  during  a 
typical  week." 

■  Part  III,  Question  32  —  Less  than  two  percent  of  the  applicable  teacher- 
respondents  used  the  response  options  "two  hours  per  week,"  "three  hours  per 
week/  "four  hours  per  week,"  and  "five  or  more  hours  per  week."  We  would 
recommend  deleting  these  response  options  and  modifying  the  last  option  to 
read  "two  or  more  hours  per  week." 


One  of  the  key  objectives  to  be  met  by  the  School  and  Teacher  Surveys  is  the 


linkage  of  descriptive  information  about  schools,  teachers,  curriculum,  and  teacher  practices  to 
individual  sampled  students.  The  linkage  of  information  about  the  sampled  students'  schooi 
environment  is  straightforward.  That  is,  etch  sampled  student's  record  is  matched  or  linked  to 
a  single  school  record/questionnaire.  Of  the  1,556  eighth  grade  students,  descriptive  school 
information  was  matched  to  a  total  of  1,396  individual  students  or  89.7  percent  of  the  student 
sample.  (Note:  The  total  number  of  sampled  eighth  grade  students  varies  with  respect  to  the 
total  number  of  eighth  grade  students  presented  in  other  chapters  of  this  repor\  due  to  the 
varying  number  of  eighth  grade  students  sampled  per  school  which  was  not  adjusted  for  during 
the  Field  Test.)  The  160  students  (10.3  percent)  who  do  not  have  matched  school  information 
are  a  result  of  the  five  school  questionnaires  coded  as  refusals  or  nonresponses. 


The  linkage  of  data  acquired  through  the  teacher  questionnaire  is  much  more 


complex  and  is  achieved  solely  through  the  Class  Schedule  matrix.  The  Class  Schedule 
identifies,  for  each  sampled  student,  the  student's  teachers  in  two  pre-assigned  cun*iculur  a^eas 
and  the  specific  course*  (i.e.,  course  title  and  class  period  or  section  number)  in  wnich  the 
student  is  enrolled.  Thus,  the  Class  Schedule  provides  the  mechanism  by  which  teacher  ratings 
of  individual  students  can  M  matched  to  the  sampled  students  as  well  as  matching  descriptive 
course  information  about  the  students*  enroled  classes. 
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Linkage  of  School  and  Teacher  Data  to  Student  Files 
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Data  processing  of  the  completed  Class  Schedules  identified  3,112  possible  student- 
teacher  and  student- coarse  combinations.  That  is,  two  teachers  and  courses  were  identified  for 
each  of  the  1,556  sampled  eighth  grade  students.  (Note:  The  total  number  of  sampled  eighth 
grade  students  varies  with  respect  to  the  total  number  of  eighth  grade  students  presented  in 
other  chapters  of  this  report  due  to  the  varying  number  of  eighth  grade  students  sampled  per 
school,  which  was  not  adjusted  for  during  the  Field  Test.) 

Of  the  3,112  student-subject  combinations,  individual  student  ratings  and  course 
information  were  matched  to  2,845  student-subject  combinations  or  91.4  percent  of  the 
expected  combinations.  Of  the  remaining  267  combinations,  74  were  not  matched  to  teacher 
ratings  due  to  student  withdrawals  from  school,  three  students  were  not  enrolled  in  courses  in 
the  pre-assigned  curriculum  areas,  and  190  combinations  were  not  matched  due  to  missing 
teacher  questionnaires  (144)  or  due  to  a  teacher-respondent's  indicating  that  he/she  did  not  have 
the  sampled  student  enrolled  ia  his  or  her  class  (46). 

Although  each  sampled  student  was  expected  to  be  matched  to  two  teacher  ratings, 
142  students  were  provided  ratings  by  more  teacher-respondents  than  was  expected.  This 
additional  yield  of  student-teacher  information  is  a  positive,  yet  unpredictable,  result  of  the 
Teacher  Survey  design. 

In  summary,  the  matching  of  school  and  teacher  data  to  individual  students  was 
achieved  for  approximately  90  percent  of  the  eighth  grade  student  sample.  Thus,  o  alterations 
are  proposed  to  the  School  and  Teacher  Survey  designs  for  the  base  year  effort. 

5.9  Summary  of  Recommendations 

Overall,  the  Field  Test  of  the  School  and  Teacher  Survey  has  been  judged  a  success. 
Response  rates  achieved  regarding  the  administration  of  the  school  and  teacher  questionnaire 
exceeded  90  percent.  In  addition,  item  response  rates  were  more  than  sufficient,  while 
respondents  infrequently  "refused"  to  respond  to  items  or  responded  "Don't  Know." 

Although  all  Field  Test  activities  wer,  successfully  conducted  several  modifications 
to  procedures,  materials  and  questionnaires  have  been  discussed  in  the  previous  sections  of  thia 
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chapter.  This  final  section,  summarizes  the  recommendations  which  have  been  suggested  to 
enhance  the  undertaking  of  the  NEL&88  base  year  study.  Our  recommendations  are  presented 
and  highlighted  in  the  following  three  broad  categories:  pre-su»vey  activities,  data  collection 
activities,  and  instrumentation.  Each  category  is  summarized  below. 

Pre-survey  activities.  Prior  to  the  distribution  of  questionnaires  to  respondents, 
several  sources  of  information  were  required,  and  links  between  these  sources  had  to  be 
maintained  in  order  to  meet  the  overall  study  design  goal  of  linking  school  and  teacher 
information  to  individual  sampled  students.  Data  files  needed  to  initiate  data  collection  efforts 
for  the  school  questionnaire  were  straightforward  and  posed  little,  if  any,  problems.  However, 
some  timing  concerns  were  found  in  the  acquisition  and  merging  of  data  files  and  materials 
necessary  for  the  administration  of  the  teacher  questionnaire. 

First,  a  Class  Schedule  matrix  was  to  be  completed  by  school  coordinators  in  order 
to  identify  the'  sampled  students9  teacher*  and  classes  in  the  two  designated  subjects.  Ia  some 
cases,  coordinators  made  errors  which  required  telephone  followup  contacts  by  NORC  or  Westat 
staff  to  clarify  discrepancies.  Second,  completion  and  processing  of  the  class  schedule  matrix 
was  to  be  completed  at  least  10  to  12  working  days  prior  to  the  Field  Test  school's  assigned 
survey  day.  In  more  than  one-half  the  cases,  this  target  completion  date  was  not  met.  As  a 
result,  in  these  cases  an  alternative  plan  was  needed  for  the  distribution  and  return  of  completed 
questionnaires. 

The  alternative  mailing  plan  proved  to  be  workable  for  the  Field  Test  because  of 
the  small  number  of  schools  participating  in  the  Field  Test.  Specifically,  on  any  given  day  the 
number  of  lat?  arriving  Class  Schedules  that  required  special  processing  was  low.  Should  such  a 
plan  be  relied  upon  in  the  conduct  of  the  base  year  study,  we  project  that  extraordinary  efforts 
would  be  required  to  deliver  questionnaire  packages  prior  to  survey  day  (i.e.,  manual  production 
of  questionnai  e  and  address  labels,  rather  than  computer-based  procedures,  etc.).  The 
alternative  mailing  plan  is  not  feasible  for  the  base  year  study  unless  the  proportion  of  schools 
requiring  such  an  approach  was  drastically  lower  than  proportion  of  Field  Test  schools. 

Consequently,  Westat  and  NORC  are  discussing  ways  to  avoid  the  delays 
experienced  in  the  collection  and  synthesis  of  pre-survey  information.  Completion  of  the  Class 
Schedule  matrix  cannot  begin  until  the  student  :ample  has  been  identified  by  NORC  personnel. 
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As  experienced  in  the  Field  Test,  an  average  of  slightly  less  than  two  weeks  is  required  to 
collect  completed  Class  Schedules.  Therefore,  Westat  and  NORC  are  exploring  the  possibility  of 
combining  the  student  sample  selection  and  collection  of  the  Class  Schedule  matrix.  One 
strategy  for  accomplishing  this  goal  would  be  to  have  NORC  field  staff  visit  each  school  to 
draw  the  student  sau  pie  on-site.  Once  the  sample  was  drawn,  the  c;hool  coordinator  could 
work  with  NORC  field  staff  to  complete  the  Class  Schedule  for  the  sampled  students.  This 
approach  would  reduce  the  error  rate  noted  in  completing  Class  Schedule  forms,  reduce  the  pre- 
survey  data  collection  time,  and  allow  the  preparation  of  data  collection  materials  to  begin 
earlier. 

Data  collection  activities.  Once  questionnaire  packages  were  transmitted,  remaining 
survey  activities  were  completed  with  very  few  problems.  The  added  burden  of  tracking 
questionnaires  through  two  different  distribution  methods  was  basically  a  logistical  concern. 
Additional  nonresponse  efforts  were  required  for  missing  and/or  incomplete  questionnaire 
packages  returned  by  school  coordinators  (using  the  alternative  distribution  approach).  The 
added  logistical  concerns  and  nonresponse  followup  efforts  can  be  alleviated  by  modifying 
timing  of  the  collection  of  pre-survey  information. 

Instrumentation.  As  reported,  questionnaire  and  item  nonresponse  rates  for  the 
school  and  teacher  questionnaires  were  quite  low.  In  general,  the  person-hours  required  by 
respondents  to  complete  each  questionnaire  exceeded  project  staff  projections.  These  fir*  'tngs 
make  it  necessary  either  to  reduc  the  length  of  both  questionnaires  to  remain  within  the 
original  response  burden  targets  or  to  provide  respondents  with  a  more  accurate  assessment  of 
the  anticipated  response  burdens  relative  to  the  NELS:88  base  year  instruments  and  to  anticipate 
a  higher  rate  of  nonresponse  and  data  retrieval  followup  activities. 

Several  specific  modifications  to  problematic  items  have  been  identified  and 
discussed  in  the  preceding  sections  (see  Sections  5.7.1  and  5.7.2).  Overall,  directions  for 
completing  the  questionnaires,  individual  wording  of  item  stems,  and  item  "esponse  scales  were 
well  understood  by  respondents  and  were  effective  in  acquiring  the  targeted  information. 
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CHAPTER  6:    OTHER  FINDINGS 


6.1      Records  Availability 

After  completion  of  the  Field  Test  Student  Survey  in  the  eighth- 
grade  schools,  NORC  Central  Office  Straff  debriefed  24  of  the  51  eighth- 
grade  School  Coordinators  concerning  accessibility  to  student  records. 
The  School    oordinator  sample  represented  public  and  private,  as  well 
as  rural  and  urban,  eighth-grade  schools.    The  debriefing  aimed  at 
assessment  of  procedures  for  collection  of  student  records  from  schools 
to  determine,  first,  whether  it  would  be  mor-  feasible  in  the  base  year 
to  collect  certain  kinds  of  name-specific  student  data  from  school 
records  or  from  alternative  sources  (such  as  parent,  teacher,  or 
student  questionnaires)  and,  second,  if  this  information  is  collected 
from  the  schools,  whether  it  would  be  more  effective  to  use  School 
Coordinators  or  NORC  Team  Letdcrs  to  obtain  it. 

Whet:  they  met  in  June  1986,  members  of  the  National  Advisory  Panel 
(NAP)  agreed  that  several  data  elements  would  be  more  efficiently 
obtained  from  students1  cumulative  records  than  from  any  other  source. 
Contractors  agreed  to  develop  a  plan  to  collect  information  about 
students1  schedules,  their  age  and  race,  their  handicapped  status, 
liiiited  English  proficiency  status,  school  meal  program  participation 
and  Title  I,  Chapter-1  eligibility  and  participation  from  school 
records.    The  Panel  held  that  these  proceedings  should  help  to  reduce 
respondent  burden,  if  on^y  to  a  small  degree*    There  was  also  the 
possibility  that  school  records  concerning  these  kinds  of  student  data 
might  be  more  accurate  than  questionnaire  responses. 

However,  there  could  be  significant  risks  and  obstacles  inherent 
in  this  procedure.    If  school  staff,  such  as  the  NELS:88  School 
Coordinator,  were  used  to  collect  the  student  data,  school  burden  would 
be  increased.    One  possible  way  to  reduce  the  burden  on  the  school  was 
to  use  NORC  Team  Leaders,  rather  than  School  Coordinators,  to  look  in 
school  files,  locate  and  make  copies  of  the  information  which  NORC  is 
interested  in  obtaining.    For  this  procedure  to  be  effective  in  the 
base  year,  it  is  important  to  know  if  the  schools  keep  the  particular 
kinds  of  records  that  NORC  is  considering  obtaining,  whether  the 
records  are  easily  accessible,  and  if  permission  would  be  necessary  for 
Team  Leaders  to  look  in  school  files  and  copy  student  records.  Should 
most  schools  require  that  special  types  of  permission  be  obtained 
before  Team  Leaders  could  gain  access  to  school  files  and  student 
records,  an  important  question  would  be  whether  this  would  be  an 
effective  procedure.    More  specifically,  if  we  have  to  get  individual- 
level  permissions  (for  instance,  from  parents)  to  obtain  name-specific 
student  information,  it  would  be  unlikely  that  we  would  get  them  all, 
the  result  being  lost  data.    Records  permissions,  if  coupled  with  the 
other  requirements  of  the  survey,  could  increase  the  number  of 
individual  and  school-level  refusals,  damaging  the  research  effort  in 
an  important  way.    These  a^e  some  of  the  central  issues  which  need  to 
be  resolved  prior  to  implementation  of  the  base  year  survey. 
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In  order  to  address  some  of  these  questions,  School  Coordinators 
were  debriefed*    In  the  debriefing,  they  reported  whether  the  schools 
they  represented  kept  the  following  kinds  of  student  records;  student 
race  and  sex,  handicapped  and  LEP  statu-,  class  schedules,  school  meal 
programs,  and  eligibility  for  Title  I,  Chapter-1.    If  the  schools  did 
keep  these  records,  School  Coordinators  noted  whether  the  records  were 
centrally  located  and  easy  to  find  or  generate.    They  also  clarified 
policies  concerning  the  granting  of  permission  for  NORC  to  send  in  a 
Team  Leader  to  view  or  make  copies  of  some  of  the  records. 

The  overall  findings  of  the  School  Coordinator  debriefing  indicate 
that  the  kinds  of  records  that  NORC  is  considering  obtaining  are 
generally  kept  by  the  schools  and  are  easily  accessible  by  school  staff 
land  specifically  the  person  designated  as  the  School  Coordinator). 
Evidence  for  the  availability  of  relevant  student  records  and  for  the 
School  Coordinators1  accessibility  to  these  records  can  be  found  in  the 
field  test  results  as  well.    During  th^  collection  of  student  rosters 
in  the  schools,  School  Coordinators  were  asked  to  add  to  these  rosters 
information  on  student  sex,  race,  LEP,  and  handicapped  classifications 
so  that  students  eligibility  for  the  sample  could  be  determined  by 
NORC.    (Data  on  school  meal  programs  and  on  Title  I,  Chapter-1  were  not 
included  on  the  roster.)    Central  Office  Staff  report  that  all  of  the 
School  Coordinators  included  the  desired  information  on  the  student 
rosters.    However,  a  number  of  School  Coordinators  said  that  permission 
was  needed  to  put  that  kind  of  information  on  the  roster.    A  few  noted 
that  this  kind  of  information  was  not  allowed  to  be  kept  on  the  roster, 
according  to  a  state  directive.    When  these  School  Coordinators  added 
the  student  information  to  the  rosters,  they  said  that  they 
did  not  want  to  be  held  responsible  and  were  not  certain  of  the 
accuracy  of  their  information,  based  as  it  was  on  their  own  assessments 
of  student  race,  sex,  handicapped  and  LEP  status. 

Another  important  finding  of  the  School  Coordinator  debriefing  was 
that  while  schools  generally  kept  the  pertinent  kinds  of  student 
records  and  while  these  records  were  easily  accessible  to  the  School 
Coordinators,  the  schools  would  not  usually  make  their  files  and 
records  directly  available  to  NORC  Team  Leadevs,  without  prior 
permission  having  been  obtained.    Procedures  for  gaining  permission 
varied.    Most  commonly,  explicit  parental  consent  or  district,  state, 
or  legal  permission  was  necessary  before  NORC  Team  Leaders  could  be 
allowed  to  view  school  files  or  make  copies  of  student  records. 

In  the  following  sections,  the  specific  results  of  the  School 
Coordinator  debriefing  are  presented. 

'6.1.1      Records  on  Student  Sex  and  Race 

Records  on  Sex  of  students  are  kept  in  87.5  percent  of  the  24 
schools  represented  by  the  sample  of  School  Coordinators  debriefed. 
The  School  Coordinators  judged  rhese  records  to  be  easily  accessible  to 
them  in  90.5  percent  of  the  schools  which  kept  such  records.  Records 
on  the  Race  of  students  are  kept  in  70.8  percent  of  the  schools 
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sampled.  These  Race  records  are  easily  accessible  in  88.2  percent  of 
the  schools  which  keep  such  records. 


6.1.2      Student  Class  Schedules 

School  Coordinators  reported  that  in  95.8  percent  of  their 
schools,  student  class  schedules  are  available.    These  class  schedules 
are  easily  accessible  in  100  percent  of  the  cases.    In  the  field  test, 
student  class  schedules  were  often  collected  directly  from  students 
on  Orientation  Day  in  cases  in  which  there  was  an  Orientation  Day. 
However,  schedule  information  exists  in  a  variety  of  forms,  and  only 
somet  mes  as  a  "Master  Teaching  Schedule."    Schedule  data  would  usually 
require  additional  processing  if  a  common  format  is  to  be  achieved. 
Additional  processing  would  entail  additional  costs  and  could  result  in 
a  larger  number  of  coding  problems  or  errors. 

6.1*3     Records  on  Handicapped  and  LEP  Student  Status 

In  75  percent  of  the  schools,  records  on  handicapped  students  are 
kept.    Where  these  records  are  available,  there  is  complete  or  100 
percent  accessibility.    Records  on  student  LEP  status  are  kept  in  58.3 
percent  of  the  schools  sampled.    In  schools  that  keep  these  records, 
access  to  the  records  is  easy  in  88.2  percent  of  the  cases. 

6.1.4  Records  on  School  Meal  Program  and  on  Eligibility  for  Title  I, 
Chapter-1 

In  70.8  percent  of  the  schools,  there  is  a  school  meal  program  for 
which  records  are  readily  accessible.    Records  on  eligibility  for  Title 
I,  Chapter-1  are  also  maintained  and  easily  available  in  61.9  percent 
of  the  schools. 

6.1.5  Summary  of  Student  School  Records  Availability/Accessibility 

The  student  records  (on  sex,  race,  handicapped  and  LEP  status,) 
class  schedules,  meal  programs,  and  Title  I,  Chapter-1  eligibility) 
which  NORC  is  considering  obtaining  for  the  base  year  survey  are  kept 
by  most  of  the  sampled  schools  anC  are  generally  accessible  to  School 
Coordinators.    However,  most  schools  require  some  type  of  permission 
before  they  would  allow  a  NORC  Team  Leader  to  view  and  copy  student 
records.    The  kinds  of  permission  which  are  required  are  discussed  in 
the  next  sections. 

6.1.6  Kinds  of  Permission  Necessary  for  Team  Leader  Access  to  School 
Files  and  Student  Records 

In  the  debriefing,  School  Coor  'nators  were  asked  what  kinds  of 
permission  we  would  need  to  gain  access  to  the  above  files.  More 
specifically,  they  were  asked  what  kind  of  permission  would  be 
necessary  for  NORC  to  send  i.i  a  Team  Leader  to  view  or  make  copies  of 
some  of  the  files.    The  respondents  sometimes  indicated  that  more  than 
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one  kirJ  of  permission  was  .^cesjary.    The  situation  of  multiple 
answers  results  in  a  total  number  of  responses  of  31,  rather  than  24 
(the  number  of  respondents;.    School  Coordinators  listed  Explicit 
Parent  Permission  most  often  (<>2  percent  of  responses),  followed  by 
District  or  State  Permission,  and  checking  with  legal  authorities  (a 
total  of  58  percent  of  responses).    (When  School  Coordinators  cited 
legal  authorities,  they  said  that  it  was  necessary  for  them  to  check 
with  their  own  district  lawyers  to  see  if  any  laws  prohibited  their 
giving  out  of  name-specific  student  records.)    Only  4  percent  of 
responses  referred  to  School  Procedures  (o.  a  request  for  permission 
properly  fil^d).    Finally,  there  was  one  r  iponse  (4  percent  of  the 
total  responses)  that  the  Team  Leader  can't  view  school  files  or 
records  at  all. 

Within  the  category  of  District  and  State  Permissions  and  checking 
with  legal  authorities,  the  14  responses  which  constituted  the  37 
percent  v~r«  distributed  in  the  following  manner:    4  responses 
indicating  required  checking  with  district  lawyers,  2  responses  citing 
approval  by  state  authorities,  7  resoor^es  noting  required  cleararce  at 
the  school  distri,     level,  and  1  response  referring  to  a  request  for 
permission  involving  the  school  principal. 

6.1.7  Summary  of  Requir   „  Permissions 

It  is  clear  that  although  the  records  which  NORC  is  considering 
obtaining  for  the  base  year  survey  are  generally  available  at  „e 
schoolt,  and  although  these  records  ar*>  usually  easily  accessible  to 
the  School  Coordinators,  they  would  ™t  be  available  to  NORC  Team 
Leaders  without  prior  permission  of  varying  kinds.    In  other  words, 
while  the  School  Coordinators  in  uost  cases  can  easily  go  through 
school  fi!»s  and  pull  oul  student:  data  to  add  to  rosters  (if  the  data 
are  not  already  stored  on  the  rosLCre),  T«am  T.eaoers  would  not  be  able 
to  do  this  unless  they  have  obtained  the  appropriate  kind  of  permission 
beforehand.    It  seems  clear  that  schools  cannot  easily  allow  cutsider3 
to  come  in  and  go  through  files  and  records  containing  name-specific 
ptudent  data.    School  Coordinators  would  have  easier  access  to  the 
nformation  which  is  of  intercut  to  NORC.    However,  there  remains  the 
problem  of  over  burdening  them  and  the  school.    And  in  a  few  cases  it 
is  evident,  based  on  the  field  test  experience,  that  ther*  would 
probably  still  be  a  requirement  for  permission  before  th<*  School 
Coordinator  could  reieare  the  student  data  he  collected  to  NORC. 

6.1.8  Conclusions 

The  feasibility  of  collecting  name-bp* -if  ic  information  ci  student 
sex,  race,  LEP,  handicap,  class  schedule,  participation  in  school  meal 
program,  and  eligibility  for  Title  I,  Chapter-1  from  school  records 
needs  to  be  studied  carefully.    The  advant^e3  of  collecting  these 
kindfl  of  information  from  school  records  rather  than  from  alternative 
sources  (such  as  parent,  teacher,  or  student  questionnaires)  are, 
fir«t,  that  school  records  may  be  more  accurate,  and  second,  respondent 
burden  might  be  decreased.    However,  there  were  cases  in  the  field  test 
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in  which  school  records  were  either  unavailable  or  inaccessible  to  the 
School  Coordinators,  who  chen  had  to  classify  students  on  the  basis  of 
their  own  assessments  and  who  could  not  vouch  for  the  accuracy  of  these 
classifications.    Also,  if  not  all  the  schools  keep  these  kinds  of 
records  (or  if  some  of  them  won't  release  the  information  to  us),  then 
qt^stions  aimed  at  collecting  this  information  would  still  need  to 
appear  on  questionnaires.    Finally,  school  records  exist  in  many 
formats,  whereas  a  questionnaire  imposes  a  uniform  format  on  the  data. 

Because  the  School  Coordinators,  compared  with  the  Te^  Leaders, 
have  easier  access  to  student  records  and  would  not  in  most  cases 
(according  to  field  test  findings)  need  to  obtain  permission  before 
collecting  and  transmitting  to  NORC  name-specific  student  data,  it 
would  be  more  effective  to  use  them  to  collect  this  information,  if  it 
is  to  be  collected  from  the  schools.    However,  chere  is  a  serious  risk 
in  increasing  the  school  burden  by  using  the  School  Coordinator  to 
gather  this  information    This  risk  becomes  greater  if  standardized 
forms  are  used.    For  ex^iiiple,  it  would  cake  the  School  Coordinator  more 
time  to  fill  out  a  standard  form  for  each  student  class  schedule  than 
it  would  take  hia  to  photocopy  school  records,  in  whatever  form  they 
exist.    On  the  other  hand,  the  use  of  the  Team  Leaders  to  collect  this 
information  from  the  schools  would  reduce  the  burden  on  school  staff. 
The  process  of  obtaining  the  kinds  of  permission  that  are  required  for 
them  to  look  at  scnool  files  and  copy  school  records  would  undoubtedly 
be  complicated  and  time-consuming.    Records  permissions,  coupled  with 
the  other  requirements  of  the  survey,  could  increase  the  number  of 
individual  and  school-level  refusals,  harming  the  research  effort  in  a 
major  way. 

Determination  should  be  made  of  the  accuracy  of  parental,  teacher, 
and  student  reporting  of  the  student  classifications  which  NORC  is 
Interested  in  collecting  for  the  base  year  sample.    It  may  be  the  case 
that  information  from  parents,  for  example,  Is  as  accurate  as  that 
given  in  school  records.    Questions  concerning  these  kinds  of  student 
classifications  (race,  3ex,  etc.)  are  already  included  in  the 
questionnaires.    If  those  data  are  collected  only  from  rrspondents  (and 
not  from  school  records),  no  additional  respondent  burden  (over  that 
which  exists  now)  would  be  imposed.    It  could  bo  the  case  that  such 
respondent  burden  is  less  than  that  imposed  on  the  schools  demands  on 
staff  time  and  requests  for  permissions. 

6.2      Student  Dispersion  and  che  First  Follow-Up  Survey 

The  first  follow-up  3urvey  of  NELS:88  will  be  conducted  in  1990. 
The  sample  design  for  NELS:88  draws  upon  experiences  from  other  first 
follow-up  surveys  conducted  by  the  Longitudinal  Studies  Lranch  of  the 
Center  for  Education  Statistics,  incjuding  HS&B.    One  significant 
difference  between  HS&B  and  NELS:88  is  the  grade  level  of  the  base  year 
cohort:     tenth  grade  in  HS&B  and  eighth  grade  in  NELS:88.    Th*  two  year 
*ge  gap  creates  fundamental  distinctions  between  the     irveys  that 
influence  the  size  of  the  follow-up  effort. 
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6.2.1     Grade  Levels  and  School  Transitions 


Grade  level  organization  patterns  of  schools  tend  to  include  tenth 
and  twelfth  grades  in  the  same  school  but  are  less  likely  to  include 
eighth  and  tenth  grades.    This  distinguishes  HS&B  and  NELS:88  first 
follow-up  data  collection  strategies.    HSIP  followed  up  tenth  graders 
v  two  years  later,  when  they  were  twelfth  g:nders.  Because  most  tenth 

grade  students  attend  the  same  school  two  years  later,  the  base  year 
sample  of  tenth  grade  schools  served  well  for  a  sample  of  twelfth  rad* 
•chools.    Whereas  HS&B  could  count  on  finding  most  students  in  the  same 
school,  probably  in  intact  classes,  the  situation  for  NELS:88  is  quite 
different.    Most  eighth  grade  students  will  not  attend  tenth  grade  in 
the  same  schools.    In  fact,  between  90  and  95  percent  of  eighth  grr.de 
students  will  pr^ably  change  schools  between  1988  and  1990.  NELS:88 
will  have  to  prepare  to  locate  and  track  students  who  have  scattered  to 
different  schools  as  individuals  rather  than  as  classes. 

In  addition  to  the  fact  that  most  eighth  grade  students  .ill  not 
attend  tenth  grade  in  the  same  school  building,  the  period  between 
eighth  and  r.enth  grades  i«  often  the  time  during  which  important  family 
decisions  concerning  different  kirds  of  transitions  are  made.  Parents 
i^ay  tend  to  coordinate  household  moves  and  job  changes  with  the  time  of 
secondary  school  admi.:*ions.    (A  planning  conference  held  by  the  Center 
reported  increases  in  family  mobility  and  ;ob  transfers  for  families 
with  children  between  eighth  and  tenth  grades.)    Also,  private  school 
transitions  typically  occur  between  eighth  and  tenth  grades.  Students 
leave  public  schools  for  independent  or  preparatory  schools;  there  are 
substantial  changes  in  the  enrollments  of  diocese  schools;  and 
elementary  private  schools  end  their  programs  between  these  grades, 
sending  students  into  a  variety  of  ^ublic  and  independent  private 
religious  schools.    These  transitions  are  not  well  studied  an'  pose 
challenges  for  locating  and  following  students  in  the  first  follow-up. 
In  light  cf  the  discussions  concerning  public  versus  private  school 
effectiveness,  this  is  an  important  set  of  students  to  follow.  Two 
important  ramifications  of  the  two  year  difference  in  base  year  grade 
level  between  the  first  follow-up  of  HS&B  and  NELS:88  are,  first,  cost 
and  efficiency  considerations  related  to  student  flow  between  grade 
levels  and,  second,  logistics  for  tracking  individual  students. 

6.7.2.      Prediction  of  Student  Dispersion  and  Size  of  Follow-Up 

It  is  important  to  start  planning  now  for  the  Htsl  follow-up. 
Part  of  this  planning  effort  entails  nrediction  of  the  size  rf  the 
effort  ?hat  wil'  be  reQuired  in  1*30— specif ^cally  the  degree  of 
dispersion  by  individual  students  between  the  eighth  and  tenth  grades 
and  the  number  of  schools  to  which  one  would    ave  t}  go  in  order  to 
rapture  the  largest  percer*  of  students  possible  through  a  reasonable 
expenditure  of  time  and  money.    A  key  question  is  the  following:  if 
the  goal  is  to  capture  at  least  85  to  90  percent  of  rhe  base  year 
sample  two  years  later,  how  many  tenth  grade  schools  should  one  expect 
to  include  in  the  follow-up  effort?    There  are  a  couple  of  ways  one  can 
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try  to  predict  student  dispersion  and  the  size  of  the  1990  effort  based 
on  the  results  of  the  field  test  surveys. 

Aa  important  way  to  make  a  prediction  concerning  the  amount  of 
student  dispersion  that  will  occur  between  eighth  and  tenth  grade  is  to 
rely  on  student  reports  of  their  plans.    On  the  student  questionnaires 
(Question  11),  each  student  was  asked  to  name  the  high  school  that  he 
or  she  expected  to  attend.    The  accuracy  of  student  assessments  needs 
to  be  closely  examined. 

Student  reports  of  high  school  plans  can  be  checked  against  parent 
reports  in  those  schools  in  which  there  was  also  a  parent  survey.  On 
the  parent  questionnaires,  parents  were  asked  in  question  44  where  they 
expected  their  child  to  go  to  high  school.    Another  way  to  check  the 
accuracy  of  student  reports  is  to  compare  them  with  the  reports  of  the 
principals.    In  the  school  questionnaires,  principals  were  asked  (in 
question  9)  to  provide  the  name*  of  the  high  schools  that  students  in 
their  schools  would  commonly  attend  upon  completion  of  the  eighth  grade 
and  the  percent  of  students  they  expected  to  go  to  each  school. 

Once  student  responses  have  been  checked  for  accuracy,  their 
patterning  can  be  analysed  in  a  spreadsheet  format  according  to  cluster 
sire.    A  cluster  is  a  pattern  in  which  a  group  of  students  move  on 
together  to  the  same  school.    And  cluster  size  analysis  serves  as  a  way 
of  organizing  ways  to  make  decisions  concerning  sampling  and  retention 
of  students  in  the  sample.    It  will  be  important  to  determine  a  minimum 
cluster  size  to  follow-up  on  because  it  would  not  be  economical  to  try 
to  capture  all  the  students,  as  they  scatter  individually  to  a  large 
number  of  tenth  grade  schools.    The  effort  in  manpower  required  to 
locate  and  interview  each  student  two  years  after  the  base  year  survey 
would  oe  so  great  as  to  be  unfeasible  in  terms  of  cost  and  time. 
(While  this  is  generally  true,  it  may  be  possible  to  use  central 
testing  sites  for  the  follow-up  in  big  cities  where  the  number  of 
student  respondents  is  large,    If  centra)  urban  testing  sites  were  used 
in  the  follow-u^,  the  effort  and  cost  would  not  be  as  large.) 

Becauce  of  the  large  size  of  the  effort  and  the  high  cost  of 
following  each  individual  student,  it  has  been  suggested  that  a  minimum 
cluster  size  be  determined  in  relation  to  the  percent  of  students  it 
would  follow-up  on.    Determination  of  a  specific  minimum  cluster  size 
would  depend  upon  its  ability  to  capture  the  largest  percent  of 
students  in  the  follow-up  survey  through  a  reasonable  expenditure  of 
time  and  money.    Jf  a  decision  was  mac'e  t      ollow-up  all  students  going 
to  high  school  in  cluster  sizes  of,  for  e;  -.-pie,  three  or  rcore,  one 
would  need  to  know  what  percent  of  the  original  sample  would  be 
captured.    How  much  would  be  added  in  completeness  (measured  in  percent 
of  students  followed  up  on)  by  adding  a  cluster?    Another  important 
question  is  whether  different  minimum  cluster  sizes  should  be 
established  for  public  and  fo-   private  schools,  due  to  the  importance 
of  keeping  private  school  students  in  the  sample  and  the  greater 
dispersion  of  students  from  other  (non-Ca:holic)  private  schools. 
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In  other  words,  there  are  two  central  questions.    The  first  is  how 
to  folic*:  the  greatest  number  of  students  ir  the  most  economical  kind 
of  unit.    The  second  is  how  (or  to  what  degree)  to  follow  those  who  uo 
not  fit  into  that  pattern.    Th<»re  may  be  a  difference  between  the 
number  of  students  overall  and  the  numbers  of  students  in  various 
sectors  that  should  be  followed. 

It  should  be  noted  that  the  focus  in  this  analysis  is  on  ways  to 
maximize  the  number  of  students  th/ 1  could  be  followed  in  a  school-type 
settirg,  by  having  NORC  interviewers  visit  the  students1  schools  in 
order  to  pursue  students  in  different  sized  groups—or  even 
individually.    Alternatives  to  this  strategy  that  are  not  discussed 
here  but  which  may  be  used  to  follow  small  numbers  of  students  who  have 
scattered  widely,  include  going  through  the  parents  rather  than  through 
rhe  school,  or  having  students  in  an  urban  area  come  from  their 
ifferent  schools  to  a  central  testing  and  interviewing  site. 

Three  kinds  of  patterns  may  result  from  students1  transfers  to 
high  school.    One  pattern  is  chat  which  will  probably  occur  in  a  small 
number  of  cases  in  urban  areas  where  students  from  a  number  of  eighth 
grade  schools  located  near  each  ether  will  merge  into  a  smaller  number 
of  high  schools.    A  second  pattei  *  expected  to  ~ccur  in  a  substantial 
percent  (and  perhaps  even  in  u  majority)  of  the  cases,  is  *he  movement 
of  all  or  85  to  90  percent  of  the  students  from  an  eighth  grade  school 
in  a  group  to  the  same  high  school.    A  third  pattern  which  should  occur 
relacively  frequently  is  one  in  which  students  scatter  widely.  This 
pattern  is  likely  to  be  found  in  situations  in  which  the  studei  ts  have 
no  way  to  continue  on  as  an  intact  group.    It  will  probably  occur  most, 
often  in  cities  where  there  are  many  magnet  schools  and  in  the  other 
private  schools. 

Another  issue  that  needs  to  be  examined  is  the  difference  in 
response  patterns,  student /parent  agreement,  and  predicted  dispersion 
patterns  based  on  va  -it>les  such  as  school  sector  (whether  public, 
Catholic,  or  other  private),  school  gride  span,  urbanicity,  and  st  ite. 

6.2.3      Student  and  Parent  Response  Patterns  Concerning  Anticipated 
High  School  Attendance 

In  the  field  test,  parent  surveys  took  place  in  34  of  the  51 
eighth  grade  schools,  whila  student  surveys  occurred  in  all  51  schools. 
Because  studant  questionnaires  from  one  .chool  with  a  parent  survey 
were  lost  in  :he  mail,  for  purposes  of  this  analysis,  33  of  50  schools 
had  paivnt  surveys.    Student  responses  provide  a  more  complete  base 
than  do  parent  surveys  for  the  making  of  predictions,  because  they  took 
place  in  all  of  the  sample  schools.    Before  making  predictions  about 
the  degree  of  student  dispersion  and  the  size  of  the  1990  effort  based 
on  student  reports  of  plans,  it  is  necessary  to  closely  examine  student 
response  patterns  to  assess  their  completeness  and  likelihood  of 
accuracy. 
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The  33  schools  with  parent  surveys  contained  a  total  sample  of  908 
eighth  grade  students.    Of  the  total  number  of  possible  student 
respondents,  97  percent  gave  responses.    These  responses  included  the 
names  of  high  schools  that  students  expected  to  attend  and  "don't  know" 
answers.    Of  all  students  in  the  sample,  95  percent  gave  the  name  of  a 
specific  school  and  only  2  percent  said  they  did  not  know  where  they 
would  go  to  high  school. 

The  set  of  parent  responses  was  not  as  complete  as  that  of  the 
students.    Of  908  potential  parent  respondents  in  the  sample,  a  much 
larger  number  (21  percent)  either  did  not  give  an  answer  to  the 
specific  item  or  co  the  questionnaire  or  gave  a  refusal.    The  result 
was  a  significantly  lower  percentage  of  parental  responses.    Of  all 
possible  parental  respondents,  76  percent  (as  opposed  to  95  percent  of 
the  students)  named  particular  high  schools  that  they  expected  their 
children  to  attend  and  almost  4  percent  said  they  did  not  know  where 
the  child  would  go. 

These  figures  suggest  that  on  this  particular  question  (i.e., 
where  the  eighth  grader  will  go  to  high  school),  the  students  might  be 
bette*  respondents  than  the  parent*,  at  least  in  terms  of  providing  the 
name  of  a  high  school.    Because  only  the  first  609  of  775  parent 
questionnaires  were  subject  to  retrieval,  lack  oi  retrieval  on  the  last 
166  could  have  slightly  mitigated  parent  response  rates.    But  retiieval 
of  even  50  percent  more  parent  responses  would  not  eliminate  the 
student  advantage.    The  face  that  students  are  good  reporters  explains 
parent-student  differences  as  much  or  more  than  lack  of  full  retrieval. 

Before  turning  to  a  comparison  of  student  and  parent  responses  and 
their  degree  of  correspondence,  it  is  useful  to  examine  response 
patterns  in  terms  of  the  variables  of  eighth  grade  school  sector,  grd.de 
soan,  urbanicity,  and  sMte. 

6.2.3.1     Student  and  Parent  Responses  by  School  Sector 

Of  the  908  students  in  the  schools  with  parent  surveys,  628  (or  69 
percent)  attend  eighth  grade  in  public  s^nools,  140  (or  15  percent)  go 
to  Catholic  schools,  and  another  140  (or  15  percent)  go  to  other 
private  schools.    There  was  no  significant  variation  in  the  percent  of 
students  from  different  sectors  naming  a  high  school  they  expected  to 
attend.    Of  sample  eighth  graders,  98  percent  of  Catholic  students,  93 
percent  of  other  private  school  students,  and  95  percent  of  public 
school  students  named  particular  high  schools  they  expected  to  attend. 
The  percent  of  other  private  students  saying  they  did  not  know  where 
they  would  go  to  high  school  is  also  slightly  higher,  at  4  percent. 

Parents'  response  patterns  varied  more  than  students'  resoonse 
oatterns  according  to  school  sector.    While  89  percent  of  Catholic 
scho      parents  named  a  high  school  they  expected  their  chi  i  to  attend, 
only  /4  percent  of  public  school  parents,  and  an  even  smaller  58 
percent  of  other  private  school  parents  named  a  hi^h  school.  The 
highest  number  of  "Don't  Know"  responses  (6  percent)  and  of  non- 
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responses  (no  answers  given  either  to  the  item  or  to  the  questionnaire 
itself) — at  36  percent— occurred  among  parents  of  other  private  school 
students,  followed  by  public  school  parents  and  then  Catholic  school 
parents.    Parents  of  Catholic  school  students  named  specific  high 
schools  most  often  and  gave  "Don't  Know"  responses  least  frequently. 

The  fact  that  response  patterns  for  other  private  school 
students  and  their  parents  were  not  as  good  (because  fewer  respondents 
named  specific  high  schools),  may  reflect  the  unique  situation  of  the 
oth*r  private  schools.    Private  schools  which  are  non-Catholic 
religious  or  independent  schools  generally  do  not  belong  to  a  system  of 
schools    as  do  public  or  Catholi  :  schools).    Students  tend  to  move  on 
from  s  .ch  schools  to  a  greater    imber  and  variety  of  kinds  of  secondary 
schools.    Greater  degrees  of  uncertainty  (and  therefore  perhaps  larger 
numbers  of  non-responses  or  "Don't  Knows")  may  relate  to  the  fact  that, 
at  least  in  the  case  of  prestigious  independent  private  schools, 
affluent  and  mobile  parents  may  not  vnow  where  the  child  will  go  to 
school  and  the  students9  plans  may  be  dependent  on  a  competitive 
application  and  acceptance  procedure.    There  will  also  be  «  lot  of 
sector  crossing  by  other  private  school  students.    (Sector  crossing  is 
described  in  detail  in  section  6.2.6.1) 

6.2.3.2     Student  and  Parent  Response  Patterns  by  State,  Urbanicity, 
and  School  Grade  Span 

The  response  patterns  of  students  and  parents  were  examined  in 
torau  of  the  following  variables:    the  state  in  which  the  school  is 
located,  the  urbanicity  classification  ot  the  school,  and  the  school 
grade  span.    The  percencs  of  students  and  parents  naming  a  specific 
high  school  are  assessed  in  terms  of  each  of  these  variables.  The 
purpose  of  this  analysis  is  to  look  for  variations  in  response  patterns 
that  might  help  predict  the  amount  of  dispersion  which  will  occur^ 

Examination  of  student  and  parent  response  patterns  in  terms  of 
the  variable  of  state  location  does  not  reveal  any  significant 
geographic  differences.    Out  of  a  possible  total  of  908  students,  97 
percent  of  California  students  named  a  particular  school,  as  did  99 
percent  of  Florida  students,  99  percent  of  Illinois  students,  99 
percent  of  New  York  students,  and  97  percent  of  Texas  students.  Then, 
was  a  little  more  variation  in  parent  response  patterns,  but  its 
significance  is  not  clear.    Of  the  total  number  of  parents,  89  percent 
ox  California  parents,  96  percent  of  Florida  parents,  100  percent  of 
Illinois  parents,  95  percent  of  New  York  parents,  and  96  percent  of 
Te>as  parents  named  specific  schools  that  they  expected  their  children 
to  attend. 

Analysis  of  student  and  parent  response  patterns  in  terms  of  the 
variable  of  school  urb-iicity  classification  is  difficult  because  8 
school?  in  the  sample  lack  file  type  urbanicity  classifications.  Among 
these  are  the  two  rural  schools  belonging  to  the  parent  survey,  and  it 
is  hard  to  determine  whirh  schools  these  are.    However,  a  comparison  of 
response  patterns  in  ur>  n  and  fiuburban  schools  is  possible.    In  the 
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schools  listed  as  urban,  97  percent  of  the  students  named  high  schools 
that  they  expected  to  attend.    In  suburban  schools  a  slightly  higher 
number  of  students  (99  percent)  named  high  schools.    The  difference 
between  response  patterns  in  urban  and  suburban  schools  was  more 
pronounced  in  the  parent  case.    While  92  percent  of  parents  of  students 
in  urban  schools  na^5d  specific  high  schools  that  the*r  children  would 
\  attend,  96  percent  of  parents  of  students  in  suburban  schools  named 

specific  high  schools.    Although  differences  between  urban  and  suburban 
schools  in  response  patterns  are  minimal,  th^  results  do  confirm  the 
view  that  in  urban  areas  it  may  be  more  difficult  for  students  or 
parents  to  name  a  high  school,  because  there  are  so  many  more  options 
(such  as  magnet  schools),  in  the  city. 

Examination  of  student  and  parent  response  patterns  in  terms  of 
the  variable  of  school  grade  span  indicates  that  there  H  a  slightly 
higher  number  of  students  (99  percent)  making  a  transfer  to  high  school 
after  ughth  grade  who  named  a  specific  high  school.    Those  who  are 
attending  schools  in  which  there  is  no  transfer  to  another  school  after 
eighth  grade  (but  rather  one  atter  ninth  grade  or  none  at  all),  named 
high  schools  97  percent  of  the  time.    It  is  a  little  surprising  that 
such  a  high  percentage  of  the  students  who  will  not  make  an  immediate 
transition  could  name  a  high  scboo!.    Parent  responses  diverged  further 
than  student  responses.    While  96  percent  of  the  parents  of  students 
making  transfers  after  eighth  grade  named  specific  high  schools,  only 
88  percent  of  parents  of  students  who  are  not  making  *  transfer  after 
eighth  grade  named  specific  high  schools,    "his  finding  suggests  that 
eighth  grade  students  and  their  parents  have  a  somewhat  better  idea  of 
high  school  plans  when  the  transfer  to  high  school  occurs  after  the 
eighth  grade  rather  than  at  a  later  time. 

6.2.4     Comparison  of  Student  and  Parent  Responses  Concerning 
Anticipated  Hijh  school  Attendance 

Parent  answers  were  collected  as  a  check  on  the  accuracy  of 
student  responses  to  the  question  concerning  the  high  school  rhey 
expected  to  attend.    The  higher  the  percent  of  agreement  between  parent 
an*!  student  responses,  the  greater  the  chances  *re  that  student  answers 
are  reliable  and,  therefore,  reflect  fairly  accu^^ely  the  kinds  of 
transitions  we  can  expect  to  occur  between  the  eighth  and  tenth  grades. 
When  parerr  and  student  both  named  the  same  high  school,  it  was  counted 
as  pair  agreement,  and  when  they  nar ed  different  high  scnools,  it  was 
tabulated  as  pair  disagreement. 

Across  all  the  school  sectors,  out  of  a  total  number  of  908 
possible  pairs  of  student  and  parent  responses,  only  76  percent  of  the 
cases  yielded  analyzable  pairs  (or  pairs  in  which  both  parent  and 
student  either  named  a  particular  high  school  or  said  they  did  not 
know/.    In  63  percent  of  the  cases  both  parent  and  student  named  the 
same  high  school  as  the  one  tl  e  student  would  attend.    In  only  7 
percent  of  the  cases  parent  and  student  named  different  high  schools. 
In  just  oyer  one  percent  ot  cases  the  student  named  a  school  but  the 
parent  said  "Don't  Know,"  whereas  in  almost  4  percent  of  cases  the 
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parent  named  a  school  but  th«  student  said  "Don't  Know."    While  only  2 
percent  of  students  failed  to  respond  to  the  question  (not  naming  it 
schooJ  or  saying  they  did  not  know)  altnough  their  parents  responded, 
20  percent  of  parents  did  not  provide  an  answer  to  the  question 
although  their  children  responded.    This  is  a  noteworthy  finding,  given 
the  fact  that  on  other  cross-tabulation  analysis  the  student  non- 
response  rate  was  much  higher  than  that  of  the  parents. 

Overall  comparison  of  student  and  parent  responses  indicate  that 
the  percent  of  agreement  between  these  sets  of  respondents  (at  63 
percent)  is  not  as  high  as  one  would  hope.    But  active  disagreement 
between  parent  and  student  is  not  prevalent,  either.    Rather,  there  are 
many  cases  in  which  one  or  the  other  respondent  said  he  did  not  know 
what  high  school  the  student  would  attend,  or  failed  to  answer  the 
question.    If  agreement  between  parent  and  student  responses  is  taken 
as  an  indicator  of  the  accuracy  or  student  responses,  then  in  63 
percent  of  tne  cases,  students  should  make  the  kinds  of  transitions  to 
high  school  that  they  indicated  in  the  questionnaires. 

*.2.4.1      Pair  Agreement  and  School  Sector 

The  pairing  of  parent  and  student  responses  yields  different 
results  when  analysed  in  terms  of  the  school  sector  of  respond  *ts. 
Parent  and  student  pair  agreement  (i.e.,  the  naming  of  the  same  high 
school  by  both  respondents)  was  highest  in  the  case  of  the  Catholic 
schools  (76  percent)  and  lowest  in  the  case  of  the  other  private 
schools  (48  percent).    Tublic  school  student /parent  agreement  (64 
percent}  fell  in  between  the  percent s  for  the  two  kinds  of  private 
scnools.    Somewfat  surprisingly,  the  amount  of  student/parent 
disagreement  (or  t*3  naming  of  two  different  high  schools)  was  also 
highest  (at  12  percent)  in  *he  Catholic  school  case.    But  there  were 
mor*  cases  with  either  parent  or  student  non-responses  and  "Don't  Know" 
answers  in  the  other  private  and  public  schools  than  in  the  Catholic 
schools.    In  the  other  private  school  sample  there  was  an  especially 
high  number  of  cases  (36  percent)  in  which  students  responded  to  the 
queiitior  (by  naming  a  high  school  or  saying  they  did  not  know),  ?  ut 
parents  did  not  give  any  response.    There  was  also  a  slightly  higher 
number  of  both  parent  and  student  "Don't  Know"  ar  wers  in  the  other 
private  schools.    The  evidence  indicates  that  Catholic  school  parents 
and  r  udents  have  the  clearest  sense  of  where  the  student  will  go  to 
high  school  and  that  they  agree  most  often,  followed  by  publi  school 
parents  and  students.    Other  private  school  parents  and  students  agree 
less  than  half  the  time  on  anticipated  high  school  attendance.  These 
findings  are  not  surprising,  given  that  other  private  schools  generally 
do  not  belong  to  any  kind  of  school  system  and  their  graduates  mov  on 
to  a  variety  of  kinds  of  high  schools. 

6.2.4.2      Student/Parent  Agreement  in  Terms  of  State,  Urbanicity,  and 
Grade  Span  of  School 

Another  way  to  examine  student/ pa rent  agreement  patterns  is  in 
terms  of  the  verifies  of  school  state  location,  urbanicity 
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classification,  and  grade  span.    In  this  manner,    it  is  possible  to 
determine  whether  there  are  geographic,  urban/rural,  or  school 
organisational  differences  that  might  contribute  to  variations  in 
student/parent  agreement  patterns. 

The  results  indicate  that  there  is  a  lot  of  variation  according  to 
the  state  location  of  the  schools  in  degrees  of  parent  and  ntudent 
agreement  (the  naming  of  the  same  high  school  by  both).    Out  of  this 
total  number  of  possible  pairs  of  students  and  parents,  there  was 
agreement  in  73  percent  of  the  Illinois  rnd  73  percent  of  the  Florida 
cases,  followed  by  65  percent  of  the  Texas  cases,  59  percent  of  the 
California  cases,  to  a  low  of  35  percent  of  the  New  York  cases.  One 
possible  explanation  for  the  much  lower  percent  of  agreement  between 
parents  and  students  in  New  York  is  the  prevalence  of  magnet  schools  in 
the  city.    (Pour  of  the  five  New  York  schools  included  in  the  parent 
survey  were  urban  schools.)  If  parents  and  children  are  faced  w-'th  many 
schooling  options,  it  is  likely  that  there  will  be  a  lower  degree  of 
consensu*  between  parents  and  cl  ildren  regarding  future  plans. 

I&  the  analysis  of  school  urbanicity  classifications,  again  the 
probles  arises  that  eight  schools  lack  urbanicity  classifications  and 
that  the  two  rural  schools  are  among  these  unlabelled  schools.  In  the 
urban  and  suburban  school  comparison    though,  it  is  possible  to  see 
clearly  that  there  is  a  higher  degree  of  parent/student  agreement 
concerning  high  school  attendance  :n  the  suburban  thiin  in  the  urban 
schools.    While  parents  and  students  agreed  in  67  percent  of  the 
suburban  schools,  they  agree  in  only  52  percent  of  the  urban  schools. 
Because  suburban  school  districts  generally  provide  fewer  schooling 
options  and  usually  do  not  have  magnet  schools,  it  is  aot  surprising 
that  a  high  level  of  agree-  jent  would  be  found  between  parent  and 
student  views  on  high  school  attendance. 

There  was  also  a  higher  level  of  agreement  between  student  and 
parent  responses  in  those  schools  in  which  a  student  transfer  is  made 
after  eighth  grace  than  in  those  schools  in  which  the  transition  to  a 
new  school  comes  later  (after  ninth  grade)  or  does  not  occur  at  all  (as 
in  K-12  sclv*  Is).    In  those  school  situations  in  which  a  transfer  is 
made  after  eighth  grade,  students  agreed  with  their  parents  (and  named 
the  same  high  school)  66  percent  of  the  time,  while  in  those  school 
situations  in  which  no  transfar  was  made  after  eighth  grade,  scenes 
agreed  with  their  parents  only  50  percent  of  the  time. 

6.2.5      School  Principals9  Reports  on  the  Projected  High  School 
Attendance  of  Their  Students 

Another  way  (besides  use  of  parent  report)  to  check  the  accuracy 
of  student  reports  concerning  expected  high  school  attendance,  is  to 
compare  them  with  the  reports  of  their  school  principals.    In  the 
school  questionnaire,  the  principal  was  asked  (in  (Question  9,  Part  One) 
to  provide  the  r*mes  of  the  schools  that  students  from  his  school  would 
commonly  attend  upon  completion  of  the  eighth  grade.    He  was  also  asked 
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to  indicate  the  percentage  of  students  that  would  usually  go  to  each 
school.    He  could  name  up  to  four  different  schools. 

6.2.5.1  Comparability  of  Principal  and  Student  Responses 

One  important  problem  emerges  in  rhe  attempt  to  compare  principal 
and  student  responses.    While  principals  were  asked  what  schools 
studerts  commonly  go  to  after  the  eighth  grade,  students  were  asked  the 
name  of  the  high  school  they  expected  to  attend  in  tenth  grade. 
Principal  and  student  responses  are  not  directly  comparable  in  all 
cases.    Students  attending  eighth  grade  in  middle  schools  (grades  7-9) 
and  K-12  schools  make  no  transfer  to  high  school  ifter  the  eighth 
grade,  remaining  instead  in  the  same  school.    If  comparisons  between 
student  and  principal  responses  will  be  made  in  the  base  year,  as  well 
as  in  the  follow  up,  it  will  be  important  to  phrase  the  question 
concerning  future  educational  plans  similarly  for  both  sets  of 
respondents.    One  way  to  facilitate  comparability  **ould  be  to  ask  the 
principals  where  their  eighth  graders"  commonly  go  to  high  school  for 
tenth  grade. 

6.2.5.2  Sample  for  otudent  and  Principal  Compac irons 

It  was  deciaed  to  compare  the  responses  of  students  from  those 
schools  which  had  parent  surveys  with  the  responses  of  the  principals 
from  those  schools.    Tufs  way  it  would  be  possible  to  examine  the  same 
set  cf  individual-level  student  responses  which  were  used  in  t'ae 
comparison  with  pare.nt  responses,  providing  continuity  in  response 
pattern  analysis.    The  parent  subsample  should  not  be  different  from 
the  rest  of  the  sample  schools,  except  that  for  the  parent  survey  there 
was  over  sampling  of  private  schools  in  order  to  make  sol 
generalizations  and  there  was  also  some  under  representation  of  rural 
areas.    It  is  predicted  that  there  will  be  more  dispersion  of  students 
and  less  agreement  between  students  and  principals  in  the  private 
schools.    In  rural  areas  where  there  are  fewer  schooling  options,  there 
is  likely  to  be  more  agreement  between  students  ^nd  principals. 

The  subsample  of  34  schools  which  haH  parent  surveys  did  not  yield 
34  analyzable  pairs  of  student  and  principal  responses.    The  school 
with  the  lost  student  questionnaires  and  two  schools  in  which  the 
principal  either  gave  a  refusal  or  did  not  return  the  questionnaire  had 
to  be  eliminated  from  the  comparisons.    Five  more  schools  had  to  be 
removed  because  they  were  KC  (1  case),  7-9  grade  schools  {3  cases),  or 
had  no  decails  of  grade  span  on  record.    In  these  schools,  there  was 
either  no  transfer  of  students  after  eighth  grade  to  high  school  or  no 
way  of  determining  if  a  transfer  occurred.    Of  the  remaining  26 
principal  questionnaires,  three  more  had  to  be  excluded  from  the 
comparison  with  student  responses  because  the  orincipals  (in  2  cases) 
had  not  named  specific  schools  to  which  the  students  would  transfer  or 
had  not  given  any  percentages  (in  one  case)  to  indicate  how  many 
students  went  to  each  school.    Therefore,  the  final  subsample  which 
yielded  analyzable  pairs  of  student  and  principal  responses  relevant  to 
projected  high  school  attendance  was  23. 
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This  subsample  of  pairs  of  principals  and  students  included 
schools  from  all  5  states  (4  in  California,  5  in  Florida,  6  in 
Illinois,  6  in  Texas,  but  only  2  in  Mew  York).    There  were  4  Catholic, 
3  other  private,  and  16  public  schools  in  the  subsample.    With  respect 
to  urbanicity  classifications,  7  were  suburban,  9  were  urban,  and  7 
were  blank.    (For  unclear  reasons,  all  cases  in  the  subsample  from 
Florida  lacked  urbanicity  classifications.) 

6.2.5.3      Principal  and  Student  Response  Analysis  and  Comparison 

For  each  school  in  the  subsample,  the  percent  of  student  who  said 
wiiey  expected  to  attend  one  of  the  high  schools  that  the  principal  had 
also  named  as  one  commonly  attended  by  hi*  students  was  determined. 
The  percent*  of  students  planning  to  go  to  each  of  the  schools  listed 
by  the  principal  were  copjired  with  the  percents  which  the  principal 
himself  had  given  for  each  school.    A  formula  wa*  developed  for 
determining  the  degree  of  agreement  which  existed  between  the  responses 
of  the  principal  and  those  of  the  students.    A  high  degree  of  agreement 
was  indicated  when  85  percent  or  more  of  the  students  said  they 
expected  to  attend  the  school  (or  schools)  named  by  the  principal. 
Allowance  was  made  for  the  principal  to  be  a  few  students  off  in  his 
estimate.    (The  clustering  of  agreement  percentages  between  85  and  90 
percent  influenced  selection  of  85  rather  than  a  high  number  as  the  cut 
off  point  for  a  high  agreement  assessment.)    Moderate  levels  of 
agreement  were  assessed  to  be  those  ranging  from  about  70  to  84 
percent.    In  other  words,  between  70  and  84  percent  of  the  students  in 
an  eighth  grade  school  agreed  with  the  principal's  response  concerning 
projected  high  school  attendance.    Low  levels  of  agreement  were  found 
to  be  those  of  less  than  70  percent  correspondence  of  student  responses 
with  principal's  responses. 

There  wat  a  high  level  of  agreement  between  the  students  and 
principal  in  16  out  of  23  cases  (70  percent  of  cases).    In  each  of 
these  cases,  85  percent  or  more  of  the  students  in  a  school  sample 
planned  to  attend  a  school  that  the  principal  uad  listed  as  a  comnon 
destination.    There  were  moderate  levels  of  agreement  between  the 
students  and  principal  in  4  more  schools  (  or  17  percent),  indicating 
that  between  70  **d  84  percent  of  the  students  planned  to  attend 
schools  named  by  the  principal.    In  only  3  cases  (13  percent)  were 
there  low  levels  of  agreement  between  th«.  students  and  principal, 
indicating  that  less  than  70  percent  of  the  students  planned  to  attend 
schools  that  the  principal  had  listed.    These  levels  of 
student/principal  agreement  are  quite  high.    If  the  principal's  report 
is  taken  as  a  check  on  the  accuracy  of  the  student  report,  it  would 
have  to  be  concluded  that  che  sturent  reports  are  generally  accurate 
and,  therefore,  indicate  the  kii^s  of  transfers  which  will  actually 
occur  between  the  eighth  and  tenth  grades. 

The  amount  of  agreement  that  existed  between  students  and 
principal  in  each  school  varied  from  a  high  of  97  percent  to  a  low  of 
zero.    In  one  other  private  school,  the  schools  listed  by    the  students 
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and  by  the  principal  were  totally  divergent,    (Although  students  listed 
17  different  high  schools,  none  of  these  was  among  the  3  listed  by  the 
principal.)    The  principals  of  these  23  eighth  grade  schools  named  a 

i  total  of  50  high  schools  that  their  students  would  attend,  while  the 

much  larger  number  of  students  named  113  high  schools.  Eight 
principals  named  a  single  school  to  which  100  (or  a  slightly  smaller 

^  percent  of  their  students)  commonly  go.    In  only  one  case  did  all  the 

students  who  responded  name  a  single  school.    The  overall  average 
percent  of  agreement  of  student  responses  with  those  of  the  principal 
was  79  percent. 

6.2.5.4     Student/Principal  Comparisons  by  State,  Urbanicity,  and 
Sector 

Variation  in  student/principal  agreement  patterns  by  state  is 
difficult  to  asse's  because  the  subsample  is  small  and  it  is  part  of  a 
larger  non-probability  sample  of  schools  in  only  five  field  test 
states.    The  average  percent  of  agreement  between  student  and  principal 
varied  from  a  high  of  92  percent  in  Illinois,  to  86  percent  in  Florida, 
72  nercent  in  Texas,  66  percent  in  California,  *nd  63  percent  in  New 
York*    The  lower  percent  of  agreement  found  in  New  York  may  be  a 
reflection  of  the  prevalence  of  magnet  schools  there  nnd  the  fact  that 
much  dispersion  is  common  in  large  cities.    But  because  only  two  New 
York  schools  belong  to  the  subsample  of  analyzable  pairs  of 
student/principal  responses,  and  because  those  schools  are  both  urban, 
it  is  impossible  to  make  any  kind  of  generalization  about  che  state  of 
New  York  on  the  basis  of  these  findings. 

Variation  in  the  average  amount  of  agreement  found  between  the 
responses  of  students  and  principals  in  terms  of  school  urbanicity 
classification  is  alao  difficult  to  assess.    Seven  schools  in  the 
subsample  (including  all  of  the  schools  in  Florida)  lacked  urbanicity 
classifications.    None  of  the  23  schools  which  had  an  urbanicity 
classification  were  designated  rural  schools.    (Rural  schools  may  have 
been  present  in  the  subsample  with  a  blank  urbanicity  classification.) 
The  average  level  of  principal  and  student  agreement  for  urban  schools 
can  be  contrasted  with  that  of  the  suburban  schools,  though.    In  urban 
schools  students  plan  tc  attend  the  same  rchools  listed  by  their 
principals  in  an  average  of  66  percent  of  the  cases.    For  suburban 
schools  the  average  percent  of  agreement  is  higher,  at  79  percent. 
This  number  would  be  still  higher  (89  percent)  if  one  school  with 
totally  discrepant  principal/student  responses  was  eliminated  from  the 
comparison.    It  is  not  surprising  to  find  a  higher  degree  of  agreement 
in  the  suburbs  than  in  the  city  because  there  are  often  fewer  schooling 
options  and  students  are  more  likely  to  move  on  to  high  school  in  a 
relatively  intact  group.    Of  the  cases  in  which  a  principal  named  a 
single  high  school  as  the  destination  of  all  or  most  of  his  students,  4 
schools  were  located  in  the  suburbs  and  only  2  in  the  city  (with  2 
remaining  schools  unclassified). 

As  noted,  the  subsample  included  4  Catholic,  3  other  private,  and 
16  public  schools.    The  average  amount  of  agreement  (or  of 
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correspondence  of  student  responses  to  principal  responses)  found  in 
the  public  eighth  grade  schools  was  86  percent,  followed  by  81  percent 
in  the  Catholic  schools,  and  then  36  percent  in  the  other  private 
schools.    In  the  3  other  private  school  cases,  there  was  complete 
discrepancy  between  princip«i  and  student  responses  in  one  case,  a  low 
15  percent  agreement  level  in  a  second  case,  and  93  percent  agreement 
in  the  third  caij.)    It  is  noteworthy  that  the  percents  of  agreement 
analysed  by  sector  confirm  the  prediction  that  dispersion  will  be 
greater  (and  that,  therefore,  agreement  will  be  lower)  in  the  other 
private  schools  than  in  the  Catholic  and  public  schools  (with  the 
exception  of  public  schools  in  large  cities). 

6.2.5.5      Summary  of  Compa  ison  of  Student  and  Principal  Responses 

The  checking  of  student  reports  concerning  high  school  choice 
against  the  reports  of  their  principals  reveals  a  great  amount  of 
agreement  between  the  two  sets  of  respondents.    In  only  3  cut  of  23 
cases  was  there  a  great  divergence  between  the  reports  of  students  and 
principals.    This  finding  suggests  that  student  responses  to  the 
question  on  expected  high  school  are  fairly  accurate  and  probably 
reflect  to  a  large  extent  the  kinds  of  student  transfers    which  will 
occur  between  eighth  and  tenth  grades. 

Although  they  result  from  analysis  of  pair  comparisons  in  a  small 
subs ample  of  field  test  schools,  these  findings  suggest  that  in 
situations  where  dispersion  is  expected  to  be  great  (in  large  cities 
such  as  New  York  and  in  other  private  schools),  the  average  level  A 
student  and  principal  agreement  regarding  high  school  attendance  is 
lower.    Alternatively,    higher  levels  of  student/principal  agreement 
are  found  in  suburban  schools  and  in  public  schools,  confirming  the 
prediction  that  smaller  amount*  of  student  scatter  will  occur  there. 

fc.2.6      Student  Dispersion  Between  Eighth  and  Tenth  n  ,de 

In  the  total  sample  of  50  schools  (including  those  with  and 
without  parent  surveys  and  excluding  the  school  with  the  lost  student 
questionnaires),  students  listed  a  total  of  266  different  named  high 
schools  that  they  expected  to  attend.    Student  dispersion  between  1988 
and  .1990  will  be  great.    Before  turning  to  a  discussion  of  ways  of 
analyzing  total  sample  student  response  patterns  in  order  to  predict 
th«*  amount  of  dispersion  and  the  number  of  schools  to  which  it  would  be 
necessaiy  to  go  in  1990,  it  is  helpful  to  look  at  student  dispersion 
patterns  in  terms  of  the  key  variable  of  school  sector.    It  is 
important  to  consider  the  prospect  of  school  sector  crossing  for  two 
reasons:    first,  that  students  can  be  tracked  if  they  leave  one  kind  of 
school  system  for  another  and, second,  because  comparisons  between  the 
effectiveness  of  public  and  private  school i-g  are  central  to  the  design 
of  the  study. 
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6.2.6.1     Dispersion  by  School  Sector  and  Anticipated  Sector  Crossing 

Students  in  the  5  sample  Catholic  schools  named  44  different  high 
schools;  students  in  the  7  sample  other  private  schools  named  60  high 
schools;  and  students  in  the  remaining  38  public  high  schools  namea 
162  high  schools.    These  figures  indicate  that  dispersion  in  the 
private  schools  (and  especially  in  the  other  private  schools)  will  be 
proportionally  higher  than  in  the  public  schools. 

The  field  test  results  also  indicate  that  sector  crossing  will 
occur  in  a  significant  number  of  cases.  By  "sector  crossing"  is  meant 
the  movement  of  students  from  one  kind  of  school  sector,  such  as  the 
Catholic,  to  another  kind  of  school  sector,  such  as  the  public.  The 
eighth  grade  school  sector  classification  of  each  respondent  wan  cross- 
tabulated  with  the  sector  classifications  of  the  high  school  he  said  he 
would  attend  ,in  order  that  the  degree  of  sector  crossing  in  the  first 
follow-up  study  could  be  anticipated. 

Of  the  stodents  presently  gcin^  to  Catholic  eighth  grade  schools, 
71  percent  said  they  planned  to  attend  private  religious  high  school 
(probably  Catholic  school  in  most  cases),  20  percent  said  they  expected 
to.  enroll  in  public  high  school,  and  less  than  one  percent  reported 
they  planned  to  go  to  a  private  non-religious  high  school/  (Eight 
percent  said  they  did  not  know.)  (The  answer  codes  for  the  sector  of 
the  anticipated  high  school  did  not  distinguish  between  private 
Catholic  >nd  other  private  religious  schools.    Rather,  students  could 
select  public,  private  religious,  or  private  non-religious  high  school 
as  their  objective.)    The  fact  that  as  nany  as  20  percent  o'  the 
Catholic  scudenti  planned  to  go  to  a  public  high  school  seems 
surprising  at  first.    But  this  figure  appears  more  reasonable  after  a 
look  at  the  QED  to  determine  how  many  Catholic  high  schools  there  arc 
in  the  country.    The  QED  figures  indicate  that  there  are  only  1,462 
Catholic  senior  high  schools,  compared  with  15,536  public  senior  high 
schools  in  the  United  States.    Therefore,  it  is  not  surprising  that 
oany  Catholic  school  eighth  graders  would  plan  to  go  on  to  public  high 
school • 

Of  the  public  school  eighth  graders,  a  large  percent  (94  percent) 
planned  to  continue  on  to  public  high  school,  a  little  over  one  percent 
intended  to  go  to  a  private  religious  school,  and  less  than  one  percent 
expected  to  transfer  to  private  non-religious  high  school.  (There  were 
3.5  percent  "Don |t  Know"  responses.)  If  student  projections  are  fairly 
accurate,  a  significant  amount  of  sector  crossing  by  public  school 
eighth  graders  shouli  not  be  expected. 

Other  private  school  eighth  graders  said  they  would  attend  private 
religious  high  school  in  48  percent  of  the  cases,  followed  by  public 
high  school  in  30.5  percent  of  the  cases,  and  private  non-reiigious 
high  school  in  about  17  percent  of  the  cases.    (Five  percent  said  they 
did  not  know.)    These  figures  are  somewhat  misleading  because  many  of 
these  eighth  graders  are  already  attending  a  private  religious  school, 
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but  this  fact  if  not  apparent  because  the  category  "other  private17 
includes  (without  distinguishing  between)  both  private  non-Catholic 
religious  and  non-religious  independent  schools.    The  other  private 
school  eighth  graders  will  be  involved  in  more  sector  crossing  than 
will  students  from  Catholic  or  public  schools. 

6.2.7      Clusters  of  Specified  Sizes 

A  useful  way  to  assess  the  size  of  the  1990  follow-up  effort— the 
dispersion  of  individuals  and  the  number  of  schools  one  would  have  to 
go  to  in  orde-  to  capture  the  largest  feasible  percent  of  the  base  year 
sample — i*  to  examine  cluster  sizes,  the  patterns  in  which  groups  of 
students  move  in  together  to  another  school. 

One  important  question  is  whether  a  particular  cluster  size  (for 
example,  three)  should  be  set  for  all  schools  and  students  followed  up 
only  to  the  extent  that  they  move  on  to  high  school  in  groups  of  that 
size  (three)  or  larger.    To  repeat,  the  goal  would  be  to  select  a 
minimum  cluster  size  (or  sizes)  which  would  allow  for  the  follow-up  of 
the  largest  number  of  base  year  students  as  tenth  graders  in  the  most 
economical  kind  of  unit. 

The  results  of  the  student  survey  high  school  choice  show  that  as 
the  minimum  cluster  size  to  follow-up  is  decreased,  increasing 
percentages  of  students  are  gained  up  to  a  certain  point.    Then  the 
curve  flattens  out,  and  one  gets  only  a  few  more  students  each  time  a 
cluster  is  added.    This  phenomenon  brings  up  the  issue  of  whether  it  is 
worth  the  tracking  effort  to  capture  those  few  students,  who, for 
example,  are  moving  on    o  high  school  in  clusters  of  only  one,  or  even 
two,  individuals.  How  many  more  students  are  added  to  the  sample  of 
base  year  students  followed  up  on  two  years  later  if  a  decision  is  made 
to  pursue  clusters  of  two,  rather  than  of  three,  students?    This  is  the 
kind  of  issue  that  must  be  resolved. 

Another  central  issue  is  whether  to  suggest  that  the  same  minimum 
cluster  size  be  followed  up  on  for  all  sectors  of  schools  or — due  to  the 
importance  of  protecting  the  sample  of  private  schoois — whether    a  smaller 
cluster  size  should  be  set.  for  private  than  public  schools.      While  it  is 
import  art  to  follow-up  on  at  least  85  to  90  percent  of  th?  overall  base  year 
eighth  grade  sample  two  years  later,  it  is  alsc  desirable  to  maintain  Khe 
same  representation  of  public,  Catholic,  and  ctner  private  school  students 
in  the  follow-up  as  in  the  base  year  sample*    For  this  reason  it  is 
necessary  to  consider  if  different  strategies  should  be  used  to  follow-up  on 
the  public  and  the  private  school  students. 

Below,  alternative  strategies  are  examined  with  respect  to  cluster 
size,  percent  of  students  captured  in  the  follow-up,  and  the  size  of 
the  effort  (overall,  and  distinguished  for  foolic  and  private  schools),. 
The  first  strategy  considered  is  the  setting  ol  the  same  minimum 
cluster  size  for  all  schools,  regardless  of  thsir  sector.    If  this  war 
the  strategy  selected,  it  would  be  necessary  to  decide  which  cluster 
size  works  best  to  capture  the  largest  percent  of  studerts  for  an 
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economical  effort.    The  second  strategy  considered  involves  the  setting 
of  different  minimum  cluster  sizes  for  public  and  private  (and  maybe 
even  for  Catholic  and  other  private)  schools.    For  example,  one  might 
want  to  try  to  follow  all  other  private  (and  maybe  also  all  Catholic) 
students,  but  follow  public  school  students  only  in  clusters  of  two, 
three,  or  four  (selecting  one  of  these  three  as  the  minimun  cluster 
size). 

6.2.7.1      Setting  a  Single  Minimum  Cluster  Size  for  Students  in  all 
Sectors 

In  this  section  cluster  sizes  are  examined.    Analysis  of  cluster 
sizes  helps  to  facilitate  decision-making  concerning  sampling  and 
retention  of  students  in  the  sample.    To  repeat,  the  objective  is  to 
determine  which  minimum  cluster  size  (or  sizes)  would  allow  one  to 
capture  the  largest  number  of  field  test  student  sample  two  years  later 
for  a  cost-etf icient  effort. 

Several  options  for  determining  the  size  o£  the  first  follow-up 
effort  can  be  presented  for  consideration.    Table  6-1  shows  counts  of 
clusters  of  various  sizes  based  on  student  reports  concerning 
anticipated  transfers  to  high  school.    Varying  according  to  minimum 
cluster  size  and  distinguished  by  school  sector,  the  table,  presents  the 
number  of  schools  it  would  be  necessary  to  visit  to  pursue  varying 
percents  of  students.    Caution  should  be  exercised  in  interpreting 
these  data  because  they  are  based  on  student  expectations,  and  we  can 
not  know  how  good  the  students1  predictions  are,  even  though  they  are 
somewhat  confirmed  by  parent  and  principal  predictions.    Also,  again 
tnere  is  the  problem  of  trying  to  generalize  to  all  states  from  a  non- 
probability  sample  in  five  field  test  states. 

If  the  minimum  cluster  size  was  set  for  all  sectors  .  greater 
than  five  students  moving  as  a  group  to  another  school,  it  would  be 
possible  to  capture  80  percent  of  the  public  school  students  two  years 
later,  but  only  58  percent  of  the  Catholic  school  students,  and  a  mere 
35  percent  of  the  other  private  school  students.    To  pursue  these 
students,  one  would  have  to  go  to  43  public,  7  Catholic,  and  3  other 
private  schools. 

Use  of  a  minimum  cluster  size  of  five  wo^id  allow  one  to  capture 
83  percent  of  public  school  students  (by  going  to  48  schools),  65 
percent  of  Catholic  school  students  (by  going  to  9  schools),  and  41 
percent  of  other  private  school  students  (by  going  to  5  schools).  The 
use  of  a  minimum  cluster  size  of  five  facilitates  the  fallow-up  of  a 
higher  percent  of  students  in  each  sector  but  requires  a  larger  effort 
in  terms  of  the  increased  number  of  schools  which  it  would  be  necessary 
to  visit. 

If  the  minimum  cluster  size  was  set  at  four,  one  could  follow-up 
on  85  percent  of  public  school  students  (by  going  to  55  schools),  74 
percent  of  Catholic  school  students  (by  going  to  12  schools),  and  49 
percent  of  other  private  school  students  (by  going  to  8  schools). 
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Compared  to  the  options  of  setting  cluster  size  at  greater  than  five  or 
at  five,  setting  it  at  four  would  capture  public  school  students  in  the 
percentage  desired  (i.e.,  85  percent  or  more)  but  would  still  fail  to 
achieve  optimal  percents  of  the  private  school  students. 

Setting  a  minimum  cluster  size  of  three  for  all  sectors  of 
students  would  allow  one  to  follow-up  on  87  percent  of  public  school 
students  (by  going  to  61  schools),  83  percent  of  Catholic  school 
students  (by  going  to  16  schools),  and  57  percent  of  other  private 
school  students  (by  going  to  12  schools).    Although  the  percent  of 
Catholic  students  that  would  be  captured  through  use  of  this  cluster 
size  approaches  the  minimum  percent  desired,  the  percent  of  other 
private  school  students  still  falls  far  short. 

If  one  set  a  minimum  cluster  size  of  two  for  all  sectors,  it  would 
be  possible  to  capture  89  percent  of  the  public  school  students  two 
years  later  (by  going  to  72  schools),. 88  percent  of  the  Catholic  school 
students  (by  going  to  20  schools),  and  71  percent  of  the  other  private 
school  students  (by  going  to  23  schools).    In  this  case,  the  desired 
sample  sizes  of  public  and  Catholic  students  would  be  preserved,  but 
the  other  private  school  sample  would  still  be  deficient. 

Finally,  if  the  minimum  cluster  size  w~s  set;  at  o^e,  and  each 
student  was  followed  individually,  it  would  be  possible  to  capture  97 
percent  of  the  public  school  students  (by  going  to  160  schools),  99 
percent  of  the  Catholic  school  students  (by  going  to  35  schools),  and 
95  percent  of  the  other  private  school  students  (by  going  to  60 
schools).  Data  are  missing  on  the  questionnaires  (regarding  high  school 
attendance  plans)  for  the  remainder  of  the  students,  and  that  is  the 
reason  percents  used  here  do  not  add  up  to  100  percent.  However, 
despite  this  problem  of  missing  data,  other  locator  information  would 
be  available  for  use  in  tracing  student*  in  the  follow-up.    Of  course, 
every  effort  would  be  made  to  pursue  lOi   percent  of  students  in  all 
sectors.    Although  the  use  of  a  minimum  cluster  size  of  one  would  allow 
for  follow-up  on  the  largest  percent  of  students  and  would  facilitate 
the  setting  of  a  single  minimum  cluster  size  for  all  school  sectors, 
while  still  capturing  the  desired  percent  of  each  sector  sample,  it 
would  entail  a  huge  effort.    It  would  be  both  time-consuming  and 
expensive  to  try  to  trace  all  of  these  students  as  they  transfer 
individually  (as  well  as  in  groups)  to  such  a  large  number  of  different 
high  schools. 

Use  of  a  minimum  cluster  size  of  four,  five,  or  more  than  five 
for  all  sectors  would  not  capture  the  desired  percents  of  private 
school  students  in  the  follow-up.    Use  of  a  minimum  cluster  size  of  two 
would  allow  for  follow-up  on  a  larger  percent  of  the  sample  than  would 
use  cf  a  cluster  of  three,  but  it  vould  also  require  a  larger  effort. 
Use  of  a  cluster  size  of  two  would  not  capture  the  desired  numbers  of 
other  private  school  students.    Fven  the  use  of  a  minimum  cluster  size 
of  three  would  fall  short  in  this.    If  the  minimum  cluster  si*e  was  set 
at  one,  the  effort  required  to  locate  and  interview  each  student  would 
be  too  large  to  justify  the  cost  and  time  required 
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TA8LE  6-1 


TRANSFERS  OF  SAMPLE  STUDENTS  TO  HIGH  SCHOOLS 
COUNTS  OF  CLUSTERS  OF  SPECIFIED  SIZES 
A,     PUBLIC  SCHOOL  SECTOR 
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TABLE  6-1  (CON'T) 


TRANSFERS  OF  SAMPLE  STUOENTS  TO  HIGH  SCHOOLS 
COUNTS  OF  CLUSTERS  OF  SPECIFIED  SIZES 

B.     OTHER  PRIVATE  SCHOOL  SECTOR 
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TABLE  6-1  (CCM'T) 


TRANSFERS  Or  SAMPLE  STUDENTS  TO  HIGH  SCHOOLS 
COUNTS  OF  CLUSTERS  OF  SPECIFIED  SIZES 

D~     FOLLOW-UP  -  ALL  SECTORS 

TOTAL  N  N  N  N  N  N  MISS. 

ID       TYPE       N      GT  5  _  STU'S       5       STU'S       4       STU'S       3       STU'S       2       STU'S       1       STU'S  DATA 

Est 1mat  ed 

1*t   Fu                     1,069  1,240  1,487  1,746  2,230  4  957 
High  Schools 

%  of  Students  73%  76%  80%  83%  87%  97% 

Pred  0  Publics  905  1,011  1,158  1,284  1,516  3,368 

Pred  0  Privates  51  86  137  206  394  U029 

Pred  0  Catho's  112  144  191  256  320  560 
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6.2.7.2      Establishing  a  Single  Minimum  Cluster  and  Estimating  the  Size 
of  the  Pirst  Follow-up  Effort 

How  do  these  figures  help  one  to  predict  the  size  of  the  necessary 
first  follow-up  effort  involving  a  base  year  sample  of  1,000  schools 
(800  public  and  200  private)?    The  field  test  findings  are  suggestive, 
and  it  is  possible  to  geiuialize  and  project  based  on  them  concerning 
the  sire  of  the  first  follow-up.    But  given  a  non-representative  sample 
of  just  50  schools  in  10  counties,  it  is  necessary  to  remain  aware  that 
the  data  are  limited  and  carry  no  certainty  with  them.    Use  of  an 
equation  helps  to  determine  the  number  of  schools  to  which  it  would  be 
necessary  to  go  in  the  firs;:  follow-up,  if  a  particular  minimum  cluster 
size  is  specified.    If  the  cluster  size  selected  is  5,  for  example,  one 
woulH  take  the  ratio  of  the  number  of  tenth  grade  schools  to  the  number 
of  eighth  grade  schools,  multiplied  by  800    (the  number  of  public 
schools  in  the  base  year  sample,  or  200  in  the  private  school  case)  and 
get  the  predicted  number  of  schools —  public  or  private — it  would  be 
necessary  to  go  to  in  the  first  follow-up.    Thrcugn  use  of  the  above 
equation,  the  efficiency  of  different  cluster  sizes  can  be  estimated 
for  the  first  follow-up, 

If  the  cluster  size  for  all  schools  is  ?et  at  greater  than  five,  it 
would  be  necessary  to  go  to  1,069  high  schools  in  order  to  capture  only 
73  percent  of  the  students  in  the  first  follow-up  of  the  total  base 
year  students.    It  the  minimum  cluster  size  is  set  at  five,  one  w~uld 
have  to  go  to  1,240  different  high  schools  to  get  76  percent  of  the 
eighth  graders  two  years  later.    If  the  minimum  cluster  size  is  set  at 
four,  it  would  be  necessary  to  go  to  a  total  of  1,487  different  high 
schools  to  follow-up  oii  80  percent  of  the  students.    If  the  minimum 
cluster  size  of  three  is  set,  one  would  have  to  go  to  1,746  high 
schools  and  could  capture  83  percent  of  all  students.    If  the  minimum 
cluster  size  is  set  at  two,  one  would  have  to  go    o  a  total  of  2,230 
high  schools  and  could  get  87  percent  of  all  students  as  tenth  graders. 
Finally,  if  the  minimum  cluster  size  is  set  at  one  and  a  decision  was 
mala  to  follow-up  on  all  individual,  as  well  as  all  group,  transitions 
to  high  school,  it  would  be  necessary  to  go  to  as  many  as  4,957 
different  high  schools  to  capture  97  percent  (or  100  percent,  allowing 
for  follow-up  on  students  of  the  students  with  missing  data  on  high 
school  plans)  of  the  students. 

Setting  a  single  minimuw  cluster  size  of  anything  greater  than  two 
would  not  allow  for  the  capture  of  at  least  85  percent  overall  of  the 
sample  in  the  tenth  grade  follow-up.    If  all  students  in  clusters  of 
two  are  followed  up,  then  it  would  be  necessary  to  go  to  two  and  a  half 
tenth  grade  schools  for  each  eighth  grade  school  in  the  sample.  It 
would  be  a  large  effort,  requiring  visits  to  2,230  schools  (1,516 
public,  394  other  private,  and  3?0  Catholic  schools)    Setting  the 
minimum  cluster  size  at  one  and  trying  to  follow  each  individual 
transfer  in  all  sectors  would  be  too  time-consuming  and  costly, 
although  it  would  yield  the  highest  percent  of  students. 
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6.2.7.3     Setting  Different  Minimum  Cluster  Sizes  for  rlfferent  Sectors 

Other  private  school  students  in  the  field  test  sample  plan  to 
transfer  to  various  high  schools  as  single  individuals  in  24  percent  of 
all  cases.    To  capture  a  higher  percent  of  other  private  school 
students  in  a  follow-up  effort,  it  would  be  necessary  to    et  a  minimum 
cluster  size  of  one.    Although  it  is  not  possible  to  follow-up  on 
students  of  all  sectors  as  individuals,  it  might  be  possible  to  follow- 
up  on  the  members  of  particular  subgroups  as  individuals  in  order  to 
maintain  their  adequate  representation  in  the  sample.      As  the  student 
responses  from  the  field  test  indicate,  there  will  be  much  more 
dispersion  of  other  private  school  students  than  of  public  3tudents 
(with  the  exception  of  some  large  urban  districts)  or  Catholic 
students. 

In  planning  for  the  first  follow-up,  serious  consideration  should 
be  given  to  the  possible  alternative  of  establishing  different  minimum 
cluster  sizes  for  public  and  private  schools—  or  for  public,  Catholic, 
and  other  private  schools.    A  decision  could  be  made  to  follow-up  on 
part  of  the  public  school  student  sample  by  setting  a  higher  minimum 
cluster  size,  and  to  pursue  all  of  the  private  school  students  by 
setting  a  minimum  cluster  size  of  one.    Although  Catholic  students  tend 
to  disperse  more  in  ways  dimiUr  to  the  public  school  students,  they 
are  very  important  to  the  sample  and  their  adequate  representation  'a 
the  follow-up  is  critical  to  future  discussions  comparing  the 
effectiveness  of  pub.  *c  and  private  schools. 

It  could  be  decided  to  follow-up  the  public  school  students  in 
clusters  cf  two  (capturing  89  percent),  three  (capturing  87  percent), 
or  four  (capturing  the  minimum  desired  85  percent).      Use  of  these 
different  cluster  sizes  would  require  going  to  3,368  or  1,516  or  1,284 
public  schools  in  the  first  follow-up.    If,  for  example,  it  was  decided 
to  set  a  minimum  cluster  of  three  for  public  schools,  10  percent  of  the 
public  school  students  would  be  left  out  of  the  follow-up  effort 
because  they  will  transfer  singularly  and  in  pairs  to  high  school.  One 
possibility  (cost  permitting)  would  be  to  randomly  follow-up  on  half  of 
the  public  school  students  moving  singularly  and  in  pairs,  while 
keeping  the  minimum  cluster  size  for  public  school  students  at  three. 

If  it  is  very  important  to  make  an  effort  to  capture  at  least  85 
to  90  percent  of  the  other  private  school  students  in  the  1990  follow- 
up,  it  would  probably  be  necessary  to  try  to  follow-up  on  all  of  them. 
If  one  set  a  minimum  cluster  size  of  two  for  Catholic  schools,  it  would 
be  possible  to  follow  up  on  88  percent  of  the  sample.  If  there  are  80 
Catholic  schools  in  the  base  year  sample  with  a  total  of  2,080 
students,  there  would  be  229  students  remaining  who  make  transfers  to 
high  schools  as  individuals  in  clusters  of  one.    That  would  not  be  too 
many  to  follow-up  on  as  individuals.    And  allowance  should  probably  be 
made  for  the  fact  that  some  students  will  be  lost  to  the  sample.  In 
other  words,  a  decision  might  still  be  made  to  follow-up  on  all 
Catholic  school  students,  despite  the  fact  that  88  percent  of  them 
could  be  captured  by  stipulating  a  minimum  cluster  size  of  two. 
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Whether  or  not  to  try  to  follow  all  of  the  Catholic  school  students  is 
another  important  question  that  needs  to  be  resolved. 

6,2.8     Summary  and  Recommendations 

Two  topics  have  been  addressed  in  this  section.    These  are  the 
question  of  the  accuracy  of  student  responses  conrerning  where  they 
expect  to  attend  high  school  and  the  question  of  how  to  capture  the 
greatest  number  of  students  through  an  econonical  effort  in  the  first 
follow-up  survey.    The  analyses  of  these  questions  are  briefly 
summarized  here. 

The  accuracy  of  student  reports  was  assessed  through  comparison  of 
student  responses  with  both  parent  and  principal  responses.    Because  63 
percent  of  the  students  named  the  same  school  as  their  parent  did  and 
because  the  average  mount  of  agreement  between  a  school's  students  and 
its  principal  on  the  same  issue  was  79  percent  (in  a  subsample  of 
schools  with  parent  surveys),  it  must  be  concluded  that  students' 
reports  of  plans  are  fairly  accurate  and  reflect  the  kinds  of  high 
school  transfers  which  will  occur.    Lower  levels  of  response  to  the 
question  on  high  school  attendance  plans  and  lower  amount*  of  agreement 
between  students  and  their  parents  or  principals  tend  to  be  more 
prevalent  in  situations  in  which  high  scatter  is  expected.    Field  test 
results  indicate  that  two  areas  in  which  great  student  dispersion  is 
expected  are  the  large  cities,  such  as  New  Y  rk  City,  which  have  many 
magnet  schools  and  the  other  private  schools,  which  generally  do  not 
belong  to  a  system  of  schools  and,  therefore,  send  students  on  to  a 
large  number  of  different  high  schools. 

The  second  main  issue  examined  in  this  section  is  that  of  pursuing 
optimal  numbers  of  students  in  the  first  follow-up  effort.    This  issue 
has  two  dimensions.    First,  it  is  necessary  to  decide  how  to  follow  the 
greatest  number  of  students  in  the  most  economical  kind  of  unit. 
Second,  consideration  must  be  directed  to  the  question  of  how  (or  to 
what  degree)  one  would  want  to  follow  those  who  do  not  fall  into  that 
pattern  (overall,  or  distinguished  by  sector). 

Minimum  cluster  sizes  were  used  to  organize  ways  to  make 
decisions  about  the  sampling  and  retention  of  students  in  the  sample. 
The  analysis  shows  that  if  various  minimum  cluster  sizes  were  chosen  to 
follow-up,  different  percents  of  students  would  be  captured  through 
visits  to  various  numbers  of  schools.    A  decision  must  be  made  on  the 
question  of  whether  to  set  the  same  minimum  cluster  size  to  follow-up 
for  all  students,  regardless  of  their  school  sector,  or  whether  to  set 
different  minimum  cluster  sizes  for  the  public  and  the  private  (or  even 
the  Catholic  and  the  other  private).    Because  of  the  importance  of 
retaining  private  schools  in  the  sample  and  because  of  the  greater 
degree  of  dispersion  of  students  in  the  other  private  schools,  it  may 
be  desirable  to  try  to  follow  up  on  all  students  individually,  even  if 
a  larger  minimum  cluster  size  (for  example,  of  2,3,  or  4)  is  set  for 
the  public  schools. 
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Essentially,  examination  of  the  field-test  results  indicates  that 
given  the  suggested  dispersion  patterns  of  public,  Catholic,  and  other' 
private  school  eighth  graders,  setting  a  minimum  cluster  size  greater 
than  two  would  not  permit  follow-up  of  even  85  percent  of  the  base  year 
students.    Using  the  two-person  minimum  cluster  size  would  encompass 
approximately  89  percent  of  the  field  test  public  school  students  (with 
72  schools  involved)  and  88  percent  of  the  Catholic  students  (with  20 
schools  involved),  but  only  71  percent  of  the  other  private  school 
students  (with  23  schools  involved).    Were  field-test  other  private 
students  alternatively  pursued  in  clusters  of  one,  95  percent  could  be 
followed  up  (or  100  percent  if  other  locator  information  was  used  to 
track  those  lacking  responses  to  the  question  on  high  school  plans). 
However,  60  schools  would  be  involved.    This  illustrates  the  nature  of 
the  decisioc  that  must  be  made. 

There  needs  to  be  the  right  balance  between  statistical  reasons 
and  cost  reasons  in  the  decision-making  process  concerning  follow-up 
strategies  for  sampling  and  retention  of  students  in  the  sample.  The 
power  and  efficiency  of  the  national  estimates  must  be  weighed  against 
the  power  allocated  to  subgroup  estimates.    Decisions  on  what  size 
clusters  to  follow  up  must  take  into  consideration  national  population 
estimates,  policy-relevant  subgroup  estimates  (such  as  those  relevant 
to  the  private  school  sector),  and  cost  and  organization  issues. 

Finally,  it  should  be  remembered  that  this  analysis  has  focused  on 
ways  to  maximize  the  number  of  students  one  could  capture  in  a 
classroom  setting.    Instead  of  pursuing  all  students  by  going  to  their 
schools,  there  are  two  alternative  modes  of  follow-up  which  could  be 
used  in  cases  where  very  small  numbers  of  students  (or  even 
individuals)  moved  on  to  different  high  schools.    One  would  be  to 
pursue  those  students  who  move  on  to  high  school  as  individuals  by 
going  through  their  parents  and  not  the  schools.    Another  possibility 
is  to  have  those  students  in  urban  areas  who  have  transferred 
individually  or  in  very  small  clusters  come  to  a  common  large  school  or 
other  testing  site  located  nearby  for  the  follow-up  intervie  ,  and 
tests.    These  alternatives  should  be  considered  as  ways  to  cut  down  on 
the  cost  an-i  increase  the  efficiency  of  the  effort  to  follow-up 
students  who  transfer  to  high  school  as  individuals. 
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CHAPTER  7:    SUMMARY  AMD  CONCLUSIONS 


7.0     Evaluation  of  the  Field  Test  Design 

In  this  chapter,  we  draw  conclusions  and  summarize  principal 
findings  concerning  the  adequacy  of  the  field  test  design.  This 
discussion  centers  on  four  features  of  that  design: 

1.  the  sample  plan 

2*  pre- survey  activities  (securing  cooperation,  bracking 
permissions,  orientation  day) 

3.  the  design  for  data  collection,  and 

4.  the  data  collection  instruments. 

Since  the  bulk  of  questionnaire  and  test  data  for  students  and 
parents  will  be  processed  in  a  different  manner  (optical  scanning)  in 
the  base  year,  data  processing  does  not  figure  as  a  separate  point  in 
this  discussion  of  the  field  test. 


7.1      Adequacy  of  the  Sample  Design 

The  base  year  sample  for  NELS:88  will  he  a  two-stage  clustered  and 
stratified  national  probability  sample  of  eighth  graders.    As  will  be 
the  case  in  the  base  year,  field  test  schools  vere  selected  as  the 
first-stage  units  and  students  within  schools  as  the  second  stage 
units.    School  selection  automatically  implicated  one  class  ci 
respondent,  the  school  principal.    Student  selection  provided  the  basis 
for  identifying  two  additional  classes  of  respondents — one  of  the 
child's  parents,  and  two  of  the  child's  teachers.    Selected  students 
included  net  only  a  core  sample,  but  a  supplementary  oversample  of 
Asia^-Pacif ic  and  Hispanic  students.    As  reported  in  Chapter  1,  the 
lield  test  was  limited  to  two  counties  in  each  of  five  purposively- 
selected  states.    However,  within  those  counties,  schools  were  selected 
with  probability  proportional  to  eighth  grade  enrollment,  with  an 
oversample  of  private  institutions. 

The  two-stage  approach,  private  sector  oversample,  and  use  of 
Probability  Proportional  to  Size  (PPS)  sampling  were  employed  in  High 
.School  and  beyond,  and  proved  unproblematic  procedures  for  the  NELS:88 
**eld  test.    However,  several  aspects  of  the  sampling  process — 
primarily  at  the  student  and  teacher  levels — will  benefit  from  further 
attention.    These  are,  in  particular:  (1)  identification  and  selection 
of  OBEMLA  supplementary  students;  (2)  student  sample  updating;  (3) 
selection  of  teachers.    Before  addressing  these  three  major  concerns, 
however,  it  may  be  worth  anticipating  the  possibility  of  encountering 
schools  on  a  12-month  plan  in  the  1988  sample. 
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In  Che  field  test,  <"udfcnt  samples  were  drawn  in  t\  *  autumn  and 
eligibility  for  t  s  spring  survey  was  initially  defined  in  terms  of  the 
student's  current  (autumn)  membership  in  the  eighth  grade.  The 
increasing  use  of  year-round  schooling,  especially  in  California, 
creates  a  situation  where  some  eighth  grade  students  attend  any  two  of 
th       terns  during  a  12-month  school  yea*-.    If  such  cases  are 
encountered  in  the  base  year  sample,  it  vill  be  desirable  to  define 
eligibility  at  such  schools  in  terms  of  spring  enrollment. 

Identification  and  Selection  of  OBEMLA  Supplement  Students 

Analysis  of  field  test  data  showed  that  there  were  both  student 
and  school  errors  in  identification  of  Asian-Pacific  and  Hispanic 
students.    Selection  into  the  sample  was  based  on  the  school's 
annotation  of  the  eighth  grade  roster.    Examination  of  open-ended 
responses  and  comparison  of  student  and  parent   sports  pointed  to 
considerable  student  error  in  use  of  the  "Other"  Asian  and  Hispanic 
categoric i.  (we  have  proposed  revisions  in  the  language  items  that 
should  minimise  this  kind  of  error  in  the  base  year.)    However,  student 
reports  of  membership  in  the  specifically  named  subgroups  (for  example, 
Puerto  Rican,  Cuban,  Japanese,  Korean)  were  generally  accurate.    At  the 
same  time,  schools  substantially  undercounted  (in  the  area* of  25 
percent)  these  subgroups.    While  some  amount  o£  undercounting  can  be 
tolerated,  a  major  goal  of  the  base  year  should  be  to  obtain  more 
accurate  ethnicity  annotations  from  the  school.    We  recomnend  as  the 
most  efficient  means  to  this  end  preidentif ication  of  schools  likely  to 
experience  this  difficulty  (for  example,  large  schools  with  poor  ox-  no 
ethnic  records)  and  special  efforts  to  involve  teachers  in  the  review 
of  annotated  rosters. 

Of  course,  the  sampling  fractions  for  Asians  and  Hispanics  .nat 
were  employed  in  the  field  test — somewhat  arbitrary  ratios  dengned 
simpl/  to  select  large  enough  numbers  of  both  groups  to  underwrite 
fieir  test  analyses — must  be  reworked  to  reflect  national  eighth  grade 
probabilities  for  Asians  and  Hispanics. 

Sacrple  Updating:    Students  and  Teachers 

An  additional  arer  of  sampling  concern  is  the  problem  of 
accommodating  transfers.     In  the  field  test,  a  sample  was  drawn,  pre- 
survey  activities  were  conducted  with  the  schools,  and  the  sample  was 
updated  a  week  to  ten  days  prior  to  S-jrvay  Day.    Transfer  students  were 
selected  into  the  eighth  grade  sample  employing  the  same  ratios  used 
for  selection  of  the  original  sample  in  the  particular  school. 
However,  owing  apparently  to  occasional  inaccuracies  in  original  lists 
and  (often — especially  in  schools  with  computerized  record-keeping) 
lack  of  a  clear  record  of  who  had  transferred  in  since  the  initial 
sampling  date,  the  pool  of  transfer-in  students  was  implausibly  small 
relative  to  listed  transter-outs  at  the  time  of  the  sample  update. 
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A  further  updating  difficulty  concerns  teacher  selection.  Changes 
in  the  student  sample  may  affect  the  teacher  sample.    A  teacher  who  was 
linked  to  a  particular  student  may  no  longer  be  eligible  after  the 
student  has  transferred  out,  or  a  transfer-in  may  draw  an  additional 
teacher  into  the  sample.    Given  the  complexities  of  the  present  teicher 
selection  procedure  (if  retained)  and  the  limitations  of  time,  it  will 
prove  difficult  to  adjust  the  teacher  sample  to  reflect  the  updated 
student  sample.    Whil^  no  effort  was  made  to  update  the  field  test 
teacher  sample,  an  updates  teacher  sample  will  be  desirable  in  the  base 
ye^r  • 

There  are  two  possible  approaches  to  the  problems  experienced  in 
sample  updating.    One  it  to  drav  the  sample  on-site  at  a  much  later 
date  (say  fifteen  to  twenty  days  before  Survey  Day).    This  would  have 
the  additional  advantage  that  the  teacher  matrix/ student  schedules 
could  be  collected  at  the  same  time.    However,  an  additional  school 
visit  would  be  costly  and  a  later  sampling  date  would  drastically 
shorten  the  time  available  for  permission  follow-up.    In  explicit 
consent  schools  in  particular,  insufficient  time  would  remain  to  track 
outstanding  permission  forms.    Nor  would  adequate  time  be  available  to 
return  sample  materials  to  Chicago  for  processing  and  for  generation  of 
needed  reports,  labels  and  logs. 

A  second  and  probably  preferable  solution  to  the  updating 
difficulty  is  to  provide  school  coordinators  with  a  log  for  recording 
transfer  students  from  the  date  the  original  roster  was  generated.  The 
tearher  resampling  problem  could  be  solved  by  eliminating  the  teacher 
matrix  and  surveying  all  relevant  eighth  grade  teachers  in  each 
school's  two  selected  subject  matters. 

Sampling  Teachers:  Class  Schedule  Matrices 

Indeed,  one  of  the  most  important  issues  arising  out  of  the  field 
testing  of  the  teacher  survey  is  whether  the  class  schedule  matrix  for 
teacher  sampling  could  be  dropped.    There  are  several  reasons  for 
believing  that  a  superior  alternative  would  be  to  sample  all  eighth 
grade  teachers  in  the  two  subject  areas  preselected  for  each  school, 
and  obtain  data  on  the  student-teacher-classroom  link  from  the  teacher 
quer  ionnaire. 

The  field  test  demonstrated  that  the  need  to  construct  class 
schedule  matrix  to  link  NELS:88  students  and  teachers  was  a  burdensome 
activity  for  many  schools.    It  noc  infrequently  took  School 
Coordinators  up  to  two  hours  to  construct  the  matrices.  The 
information  contained  within  them  was  frequently  wrong  and  was  often 
out  of  date  by  the  time  the  survey  took  place.    While  some  Coordinators 
were  extremely  cooperative  and  efficient,  others  required  repeated 
urgent  promptings,  a  task  not  without  its  discomforts  for  both  school 
and  contractor  staff.    Given  that  the  matrices  could  not  be  completed 
until  after  the  student  sample  was  selected,  and  that  considerable  lead 
time  was  then  required  if  teacher  questionnaires  were  to  reach  schools 
well  ahead  of  Survey  Day  and  be  collected  by  the  NORC  Survey  Team,  the 
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inevitable  result  was  that  despite  all  efforts  teacher  questionnaires 
often  did  not  reach  the  school  until  Survey  Day. 

When  we  debriefed  School  Coordinators  after  the  tield  test,  it  was 
determined  that  if  we  had  taken  all  eighth  grade  teachers  in  the  school 
instead  of  the  selected  sample,  we  would  have  added  on  average  one 
teacher  per  school.    Given  that  the  field  test  method  selected  on 
average  only  5.9  teachers  per  school,  these  additional  teachers  would 
provide  a  sample  still  below  the  numbers  originally  anticipated. 

A  sample  of  all  grade  eight  teachers  in  the  two  subject  matters 
would  offer  several  advantages  in  addition  to  speed  and  reduction  in 
school  L.rden.    If  appropriately  worded  items  appear  on  the  teacher 
questionnaire  so  that  the  linkage  between  teachers  and  NELS:88  students 
can  be  ascertained,  this  method  would  more  readily  accommodate  changes 
over  time,  including  changes  in  the  student  sample  and  classroom 
schedule.  This  procedure  would  accommodate  teacher  changes  as  well  as 
student — for  example,  teachers  who  transfer  in.  While  a  few  teachers 
could  be  selected  in  who  might  not  teach  any  member  of  the  student 
sample,  these  teachers  could  complete  all  questionnaire  items  except 
the  student  ratings.    These  additional  teachers  however  would 
contribute  to  an  overall  teacher  probability  sample  of  the  four  subject 
areas.    Their  responses  would  also  add  precision  to  the  aggregate 
school-level  composite  variables. 

Of  these  many  benefits  to  dropping  the  class  schedule  matrix, 
perhaps  the  most  important  is  the  contribution  this  would  make  to 
lessening  the  burden  of  the  school,  thus  facilitating  efforts  to  obtain 
initial  school  cooperation,  and  to  maintain  a  cooperate e  relationship 
with  school  personnel  throughout  the  survey. 

However,  a  final  decision  in  the  matter  of  the  teacher  matrix 
should  also  weigh  possible  disadvantages  to  a  change  of  procedure.  One 
such  disadvantage  is  that  while  reducing  the  burden  to  the  school 
coordinator,  the  burden  to  the  individual  teacher  of  supplying 
additional  information  might  be  somewhat  increased.    Also,  allowing 
teachers  to  be  the  sole  identifier  of  the  links  between  student, 
classes,  and  teachers  is  more  "subjective"  in  that  it  removes  some  of 
the  built-in  checks  of  teacher-provided  data.  (Teacher-provided 
linkages  are  subject  to  non-sampling  error  in  that  teacher  respondents 
may  fail  to  respond  or  respond  incorrectly  to  student-teacher-class 
links  resulting  in  "unclaimed"  sampled  students.  However,  school  class 
schedule  records  may  also  be  in  error,  and  School  Coordinator  error  in 
preparing  matrices  is  also  possible.)    Finally,  the  proposed  revision 
of  procedures  would  net  have  undergone  the  benefit  of  full-scale  field- 
testing,  though  base  ,  3ar  conditions  might  be  simulated  on  a  reduced 
scale. 

Principal  and  Parent  Selection 

There  were  no  apparent  difficulties  in  sampling  of  school 
principals.    However,  there  were  noteworthy  complexities  in  the 
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approach  to  parent  selection.    The  parent  Letter  and  the  instructions 
in  the  questionnaire  asked  that  the  instrument  be  completed  "by  the 
parent  or  guardian  who  is  most  familiar  with  rhe  student's  current 
i  school  situation  and  educational  plans. M    Although  in  most  cases 

(approximately  three-quarters)  the  mother  completed  the  parent 
instrument,  the  fact  that  a  substantial  minority  of  non-mothers  also 
answered  the  questionnaire  argues  for  continuation  of  the  present 
approach  to  parent  selection,  rather  than  predesignaticn  of  the  mother 
as  parent  respondent. 


7.2      Pre-Survey  Activities 
7.2.1      Securing  Cooperation 

Securing  cooperation  was  in  many  respects  the  most  arduous  field 
test  activity,  and  is  sure  to  be  the  major  challenge  of  the  base  year. 
While  many  districts  and  schools  cooperate''  enthusiastically,  others 
entered  the  sample  only  after  a  long  process  of  persuasion.  Still 
others  could  nut  be  brought  into  the  sample  at  all. 

In  one  respect  contacting  in  the  base  year  may  prove  easier  than 
in  the  field  test.    Many  field  test  schools  and  districts  expressed  the 
view  that  this  was  "only  a  pretest"  an<*  that  a  trial  of  procedures 
could  easily  take  place  elsewhere.    They  therefore  did  not  feel  the 
degree  of  obligation  to  the  study  that  they  might  in  the  base  year,  at 
which  time  NELS:88  would  need  their  cooperation  to  preserve  its 
national  probabilities,  and  the  collected  data  would  become  part  of  a 
long-term  research  resource.    The  several  state  and  city  augmentations 
will  also  be  factors  that  may  give  the  base  fear  study  more  persuasive 
leverage  in  certain  localities. 

On  the  other  hand,  the  base  year  survey — unlike  the  field  test, 
which  was  not  required  to  support  unbiased  population  estimates — will 
not  afford  the  luxury  of  ready  substitutions.    We  will  badly  need  to 
secure  the  cooperation  of  virtually  every  sampled  school. 

In  addition,  overlap  with  the  National  Assessment  of  Educational 
Progiess  and  the  Schools  and  Staffing  study  in  the  large  districts — 
often  precisely  those  districts  that  are  already  overburdened  by 
testing — may  create  ar  unfavorable  climate  in  certain  areas.     It  is  to 
be  hoped  that  the  coordination  efforts  to  prevent  overlap  in  the 
initial  sample  of  the  three  studies  at  tne  school  level  will  ensure  a 
measure  of  good  will  in  many  districts. 

While  a  range  of  persuasive  arguments  was  applied  in  the  field 
test,  often  with  good  effect,  one  particular  incentive  that  was  often 
mentioned  was  the  return  of  data  to  schools,  districts,  or  even  to 
individuals.    Though  the  wish  that  some  form  of  data  be  returned  was 
most  often  voiced  by  district  anil  school  officials,  some  parents 
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expressed  strong  interest  in  individual  level  data,  or  wanted  to  know 
whether  information  would  at  least  be  given  to  the  school. 


Although  contractor  resources  are  currently  not  budgeted  for 
generation  and  return  of  survey  data  to  participants,  it  should  be 
considered  whether  it  would  not  be  desirable  to  find  ways  to  make  such 
data  return  feasible.    National  findings  that  will  be  available  some 
years  hence  are  of  some  interest  to  principals  and  superintendents  but 
seldom  have  a  decisive  persuasive  effect  on  survey  participation. 
Schools  repeatedly  ask  how  their  students  and  staff  will  benefit  from 
taking  part  and  point  to  the  valuable  classroom  time  they  must 
sacrifice  in  order  to  participate.    If  the  study  offers  nothing  in 
return  at  the  school  level—nothing  that  can  directly  assist  decision- 
makers in  the  limited  educational  community  of  the  district  or  school — 
such  an  intrusion  on  student  classroom  time  may  often  seem  unwarranted. 
It  is  therefore  desirable  to  be  able  to  offer  schools  and  districts 
(and  perhaps  individuals)  summary  local  and  national  test  scores  (with 
reading  and  mathematics  scores  perhaps  expressed  in  terms  compatible 
with  NAEP).    While  cost  considerations  constrain  the  number  of  sources 
that  can  be  merged  and  levels  at  which  data  can  be  aggregated,  the 
several  '  >tions  in  this  area  should  be  explored. 

However,  many  districts  have  their  own  testing  programs,  and  often 
there  are  state  assessments  or  competency  tests  at  eighth  grade  level 
as  well.    To  overburdened  districts  that  feel  they  already  receive  a 
surfeit  of  test  data,  findings  from  the  NELS:88  questionnaires  may  be 
of  particular  interest.    The  national  comparison  point  that  the  study 
can  offer  to  schools  and  districts  should  be  especially  attractive. 
Though  students  often  are  tested,  seldom  are  carefully  constructed 
background,  behavioral,  attitudinal  and  aspirational  questions  put  to 
eighth  graders.      Less  often  still  are  data  from  a  student-linked 
sample  of  parents  and  teachers  available  to  further  illuminate  student 
results,  or  depict  relationships  between  parents  and  the  school  from 
both  a  teacher  and  parent  perspective.    Questionnaire  data  as  well  as 
test  data,  then,  could    be  made  available  in  summary  form,  and  may 
provide  an  additional  strong  incentive  for  participation. 

A  final  school  contacting  consideration  is  the  relatively  greater 
difficulty  experienced  in  securing  cooperation  from  schools  in  the 
Other  Private  sector—particularly  from  small  Christian  academies. 
These  schools  are  seldom  swayed  by  appeals  to  the  research  interests  of 
the  federal  government,  but  may  relish  the  opportunity  to  compare  their 
own  survey  results  to  a  representative  national  sample. 

7.2.2      Orientation  Day 

Judicious  consideration  must  be  given  to  assessing  the  comparative 
costs  and  benefits  of  an  orientation  day.    Overall,  the  Orientation  Day 
experiment  showed  that  this  introductory  session  had  a  marginally 
positive  effect  on  participation.  Since  participation  at  eighth  grade 
level  was  extraordinarily  high— compared  to  High  School  and  Beyond 
tenth  and  twelfth  graders  or  the  tenth  and  twelfth  grade  participants 
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in  the  NBLS:88  field  test— there  was  little  scope  for  a  more-than- 
marginal  boost  to  participation.  If  measured  by  the  narrow  criterion  of 
number  of  potential  Makeup  Days  eliminated  by  the  higher  initial 
participation  rate,  the  orientation  sessions  cost  somewhat  more  than 
they  saved.    However,  a  broader  evaluative  criterion  may  be 
appropriate. 

If  the  overall  effect  of  orientation  sessions  was  only  marginally 
positive,  nevertheless,  the  effect  in  certain  cases  was  more  dramatic. 
Specifically,  Orientation  Day  appeared  to  have  a  significant  impact  on 
student  participation  in  difficult  schools  in  the  Other  Pri^te  sector. 
In  addition,  it  was  sometimes  of  special  value  in  facilita  .ng  consent 
in  schools  requiring  explicit  parental  permission. 

Also,  Orientation  Days  appeared  to  fulfill  certain  latent 
functions  quite  apart  from  their  manifest  function  of  boosting 
response.    Team  Leaders  were  able  to  establish  personal  relationships 
with  school  personnel.    They  were  able  to  ascertain  whether  survey 
materials  had  arrived  and  were  properly  stored,  whether  the  designated 
survey  room  was  adequate,  and  were  able  to  make  reliable  judgments 
about  the  school  milieu — the  school's  degree  of  organization,  general 
climate,  and  the  characteristics  of  its  teachers  and  student  body. 
This  additional  information  was  probably  of  greatest  value,  in  schools 
most  vulnerable  to  problems  that  could  have  adversely  affected  data 
quality  and  costs. 

Additional  in-school  activities  that  would  otherwise  take  place 
jver  the  telephone—activities  such  as  the  sample  update—might  be 
folded  into  Orientation  Day.    If  this  were  done,  orientation  session 
costs  relative  to  alternatives  could  be  minimized  at  the  same  time  that 
benefits  of  a  pre-survey  school  visit  could  be  increased. 

All  in  all,  the  field  test  suggests  that  Orientation  Day  may  be  of 
significant  value  in  certain  types  of  schools.    Serious  consideration 
should  be  given  to  holding  the  Orientation  Day  in  all  schools— but  at 
the  very  least,  orientation  sessions  should  be  scheduled  for  schools 
that  are  likely  to  be  disorganized  and  difficult  to  work  in,  schools 
that  require  the  method  of  explicit  parental  consent,  and  in  many  of 
the  schools  in  the  Other  Private  sector. 

7.2.3      Permission  Tracking  and  Follow-up 

The  evidence  of  the  field  test  suggests  that  high  student 
participation  can  be  obtained  under  conditions  of  either  implied  or 
explicit  parental  consent,  but  that  the  cost,  in  monetary  and  other 
resources,  of  follow-up  of  explicit  consent  cases  can  be  prohibitively 
high.    In  base  year  contacting  activities  therefore,  the  greatest 
possible  emphasis  will  be  placed  on  the  adequacy  of  protections  offered 
students,  parents,  principals  and  districts  by  implied  consent 
measures;  and  on  the  disadvantages  to  school,  contractor,  and  the 
study's  principal  goals,  of  explicit  consent  procedures. 
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A  particularly  troublesome  case  of  explicit  consent  was  presented 
by  Hew  York  City — a  population  unit  of  the  first  importance,  that  will 
also  be  heavily  oversampled  in  1988  through  the  New  York  State  NBLS:88 
augmentation.    There,  the  standard  means  of  following  up  on  outstanding 
explicit  parental  consent  forms — telephone  or  in-person  contact— was 
expressly  forbidden.    The  New  York  City  Board  of  Education  should  be 
fe-«?pproached,  with  the  aim  of  obtaining  a  relaxation  of  either  the 
explicit  consent  requirement  or  the  restrictions  on  follow-up — or  both. 
In  renegotiating  the  conditions  under  which  NELS:88  will  operate  in  the 
city's  public  schools,  special  attention  must  also  be  given  to  the 
legitimate  consensual  concerns  of  the  Board  of  Education.    In  a 
multilingual  city  with  a  high  percentage  of  its  population  born  outside 
the  United  States,  it  cannot  be  assured  that  all  consent  forms  which 
have  not  been  returned  have  'oeen  read  and  understood  by  parents  and 
represent  cases  of  informed  tacit  agreement  that  their  child 
participate.    Contact  letters  and  permirsion  forms  may  have  to  be 
translated  into  Spanish  and  other  languages.    The  fact  that  we  will 
over  sample  Hispanics  and  Asians — and  will  have  a  large  number  of  New 
*  ^rk  State  Supplement  schools  in  New  York  City  in  addition  to  the  core 
sample — cotipounds  the  need  for  special  measures  that  will  ensure 
communication  in  a  setting  where  language  barriers  may  be  present.  The 
same  linguistic  difficulties  will  be  experienced,  if  to  a  somewhat 
lesrer  degree,  in  other  major  metropolitan  areas,  including  Los  Angeles 
and  Chicago  (which  presently  pians  a  20-school  city  augmentation). 

7.3     Data  Collection  Design 

School  survey:    Student,  Principal,  Teacher 

School  data  collection  generally  moved  quite  smooth1y  and  followed 
the  model  established  by  High  School  and  Beyond.    The  School 
Coordinator  worked  with  the  NORC  Survey  Team.    The  student 
questionnaire  was  administered,  then  the  cognitive  tests.    While  the 
cognitive  tests  were  being  completed,  survey  administrators  edited 
critical  items  in  the  student  questionnaire.    Depending  on  the  date  of 
receipt  of  the  teacher  matrix,  it  was  sometimes  possible  to  collect 
teacher  and  school  questionnaires  on  Survey  Day.    When  these 
questionnaires  could  not  be  picked  up  on  Survey  Day,  they  were  instead 
distributed  at  that  time.    Distribution  in  advance  of  Survey  Day  is  the 
preferred  method,  though  a  high  response  rate  was  obtained  by  both 
means. 

A  few  student  questionnaire  critical  items  were  not  readily 
retrievable.    Parental  occupation,  where  multiple  responses  often  could 
not  be  resolved,  is  the  paramount  example  of  this.    Clerical  Assistants 
proved  good  editors  but  may  benefit  from  additional  training  on 
difficult  items.    Elimination  of  the  occupation  categories  from  the 
student  questionnaire  would  also  help  the  editing  process.  (The  close- 
coded  occupation  question  absorbed  an  inordinate  amount  of  the  editor's 
time,  and  contributed  disproportionately  to  the  complexity  of  the 
editing  task.) 
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Some  schools  were  reluctant  to  give  up  more  than  one  class  period 
for  testing  and  surveying  of  students.    However,  schools  generally  were 
willing  to  give  approximately  one  half  school  day—usually  from  the 
morning  starting  time  until  the  mid-day  lunch  break — for  the  survey. 
(Afternoon  sessions  of  equivalent  length  were  possible  for  a  few 
schools.)    This  amount  of  tine  was  theoretically  more  than  sufficient 
even  for  administration  of  field  test  instruments,  which  are  ordinarily 
slightly  longer  than  base  year  versions.    In  practice,  however,  there 
were  some  cases  where  it  proved  difficult  to  complete  all  survey 
activities  within  the  scheduled  time.    Time  problems  did  not  reflect 
the  length  of  the  survey  instruments,  then— but  rather,  the  difference 
between  projected  and  actual  starting  times.    In  schools  that  were 
particularly  disorganised  and  where  it  was  difficult  to  assemble 
students  and  begin  on  schedule,  there  was  invariably  a  time  crunch.  We 
may  see  here  another  reason  for  supposing  that  the  informational  and 
motivating  contacts  with  students  and  school  personnel  established  in 
an  orientation  session  can  be  used  to  good  effect  in  forestalling 
problems  that  might  otherwise  occur  on  Survey  Day,    In  the  base  year, 
with  a  number  of  two-page  state  or  city  supplemental  instruments  Mding 
to  the  total  length  of  the  survey,  it  will  be  especially  importai-v  to 
ensure  conditions  whereby  all  sessions  can  begin  on  time. 


Parent  Survey 

The  parent  study  reflected  a  mixed  mode  of  data  collection. 
Questionnaires  were  distributed  within  classrooms,  or  were  sent 
directly  to  the  home  in  the  mail.    Return  of  the  survey  was  in  the 
first  instance  by  mail,  with  telephone  prompting,  followed  by  telephone 
and  in-person  interviewing  of  nonrespondents .    The  overall  parent 
response  rate  suggests  the  positive  orientation  of  parents  toward  the 
survey's  content,  and  level  of  burden;  and  suggests  that  the  data 
collection  methods  were  effective.    However,  results  of  the  experiment 
in  means  of  distributing  the  parent  questionnaire  have  important 
implications  for  the  data  collection  plan  for  the  base  year. 

Results  of  the  field  test  experiment  in  use  of  the  eighth  grade 
student  versus  the  mail  as  delivery  mechanisms  for  the  parent 
questionnaire  suggest  that  the  student  take-home  method  is  likely  to 
prove  more  effective  than  mail  delivery.    Although  students  are  not 
wholly  reliable  vehicles  for  questionnaire  delivery,  and  considerable 
remailing  is  required  under  this  method,  rhey  are  reliable  enough  to 
ensure  savings  in  cost  and  an  increase  in  effectiveness,  as  measured  by 
parental  response  rates.    There  is  some  indication  that  return  of  the 
questionnaire  to  the  school  may  be  somewhat  more  effective  than  direct 
return  to  NORC. 
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7.4     Adequacy  of  Data  Collection  Instruments 
7*4*1    Student  Questionnaire 
Questionnaire  Data  Analyses 

Although  many  of  the  items  used  in  the  NELS:88  student 
questionnaire  appeared  on  the  HS&B    ~d  NLS-72  instruments,  often  these 
questions  had  to  be  modified  for  eighth  graders,  and  data  on  their  use 
with  a  younger  population  had  not  hitherto  been  obtufned.    In  addition, 
a  number  of  new  items  appear  on  the  student  questionnaire. 

We  therefore  closely  evaluated  the  questionnaire  data  to  identify 
nonresponse  problems,  tried  to  uncover  the  causes  of  nonresponse  for 
particular  iteas,  and  suggested  appropriate  item,  instruction,  format, 
or  procedural  changes.  We  also  attempted  to  assess  data  quality  or 
validity  whenever  this  was  possible,  employing  inter-item  consistency 
checks  and  comparisons  of  data  from  different  classes  of  respondents 
(students  and  their  parents)  to  this  end. 

A  further  question  was  how  well  eighth  graders  would  perform  on 
skip  patterns — that  is,  conditional  questions  that  require  no  answer  if 
a  preceding  question  routed  them  out.    For  this  reason,  we  assessed 
logical  consistency  between  questions  r.o  determine  whether  there  were 
problems  in  questionnaire  clarity  or  design.  Examination  of  item 
response  also  afforded  an  opportunity  to  evaluate  the  effectiveness  of 
in-school  editing  and  retrieval  procedures.    Finally,  we  assessed 
questionnaire  length  by  examining  the  comparative  quality  of  responses 
to  the  final  data  elements. 

These  analyses  both  confirmed  the  effectiveness  of  the  general 
approach  to  data  collection  and  pointed  to  the  desirability  of  numerous 
specific  modifications  in  item  wording  or  questionnaire  format.  Of 
those  findings  with  implications  for  possible  modifications  in  the  base 
year  instruments,  perhaps  the  most  important  was  that  parents  are 
superior  reporters  of  certain  kinds  of  information  that  is  of 
particular  interest  for  the  base  year  survey. 

A  guiding  intuition  for  development  of  the  four  questionnaires  was 
that,  in  recognition  of  the  limits  on  the  amount  of  data  that  could  be 
collected  from  eighth  grade  students,  items  in  the  student 
questionnaire  should  be  limitea  to  those  for  which  the  individual 
student  is  the  only  or  best  informant.    In  general,  such  items  focus  on 
individual  students'  experiences,  perceptions,  beliefs,  expectations 
and  attitudes.    Data  on  students'  home  and  learning  environments,  we 
felt,  should  be  collected  primarily  from  parents  and  school 
administrators  and  teachers.    Of  course,  some  limited  redundancy  with 
contents  of  other  questionnaires  can  be  desirable,  and  provides  a  means 
to  assess,  for  example,  perceptual  differences.    In  the  field  test 
overlap  was  methodologically  desirable  as  a  means  to  gauge  item 
validities  and  to  permit  the  Mbesr  respondent"  for  certain  items  to  be 
identified. 
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Important  treat  of  parent -student  (and  in  one  case  parent-stuaent- 
school)  questionnaire  overlap  in  the  field  test  included  SES  data 
(parental  occupation  and  education),  early  educational  experience, 
receipt  of  special  services,  and  likely  high  school  of  attendance  in 
the  t*nth  grade.    In  terms  of  both  levels  of  response  and  consistency 
or  quality  of  response,  parents  proved  better  able  to  give  information 
on  occupation,  far  better  able  to  use  occupation  categories  to  classify 
parental  occupation,  and  better  able  to  report  on  parental  education— 
all  important  constituents  cf  an  SES  index.    Parents  also  proved  to  be 
superior  sources  of  information  on  the  child's  early  (pre-school  to 
kindergarten)  education,  and  better  reporters  on  the  child's  present 
receipt  of  special  services.    Students  however  had  less  nonresponse 
than  parents  on  items  relating  to  probable  school  of  attendance  in 
tenth  grade,  and  their  reports  receive  a  high  degree  of  confirmation 
from  principal  reports  in  the  school  questionnaire. 

These  results  suggest  that  certain  SES  questions — but  especially 
the  closed  occupation  categories—should  be  dropped  from  the  student 
questionnaire.    SES  data  should  be  sought  in  the  first  instance  fro*, 
the  parent,  with  some  of  the  simpler  SES  measures  (item  lists,  parent 
education  using  quite  broad  response  categories,  and  perhaps  an  open- 
ended  father's  occupation  question)  also  present  on  the  student 
instrument,  to  provide  some  SES  information  for  instances  in  which  the 
parent  does  not  participate.    Questions  about  preschool  educational 
experience  should  be  asked  primarily  of  the  parent,  and  special 
education  services  information  sought  from  school  and  parent. 

English  as  the  Language  of  Questionnaire  Administration 

The  field  test  student  questionnaire  was  produced  and  administered 
only  in  English,  although  the  plan  of  work  for  the  base  year  leaves 
open  the  possibility  of  a  Spanish  version.    District  personnel 
indicated  that  their  minority-language  eighth  graders  would  generally 
be  able  to  complete  the  test  and  q  ^stionnaire  in  English.    To  the 
extent  that  some  were  not,  however,  those  same  student j  were  excludable 
from  the  survey  since  one  of  the  ineligibility  codes  specified  "does 
not  have  English  as  a  mother-tongue  and  insufficient  co-nmand  of  English 
precludes  filling  out  questionnaires  and  tests".    Under  these 
circumstances,  administrators  thorght  there  would  be  little  or  no 
demand  for  a  Spanish-language  student  questionnaire,  though  they 
thought  a  Spanish  version  of  the  parent  questionnaire  might  provs 
useful.  (Certainly,  for  the  base  year,  the  use  of  certain  bilingual 
contacting  materials  is  advisable,  as  well  as  having  on  hand  a  number 
of  bilingual  convertors  to  talk  to  parents.)  In  High  School  and  Beyond 
in  1980,  only  43  of  30,030  sophomores  elected  to  use  the  Spanish- 
language  questionnaire. 

The  field  test  supplies  no  reason  to  suppose  the  situation  would 
prove  dramatically  otherwise  for  1988  eighth  graders.    When  we  analyzed 
high  nonresponse  items  to  see  if  response  correlated  with  certain  group 
characteristics,  one  such  classification  variable  was  mother  tongue. 
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Statistically  significant  differences  in  response  were  observed  on  only 
two  of  the  eleven  questions  on  the  basis  of  having  a  mother-tongue 
other  than  English — a  reminder  that  for  selected  items  the  unique 
aspects  of  the  minority  language  student's  experience  and 
sociolinguiatic  situation  may  require  special  sensitivity— but  evidence 
also  that  in  general  minority  language  students  could  deal  with  the 
questionnaire. 

etheless,  one  might  wonder  what  effect  exclusion  of  those  with 
extn      y  low  English  proficiency  might  have  on  the  representativeness 
of  this  uample  in  the  several  locales  where  language  minorities  are  most 
concentrated.    This  question  might  be  asked  again  in  the  context  of  the 
policy  interests  of  the  OBEMLA  Hispanic  supplement.    If  one  were  to 
exclude  froai  the  sample  only  students  who  could  respond  to  the 
questionnaire  in  neither  English  or  Spanish,  the  need  for  a  Spanish 
version  of  the  instrument  would  be  suostantially  greater. 

If  a  Spanish  language  student  questionnaire  were  produced,  this 
fact  might  have  implications  for  the  parent  questionnaire.    In  the 
field  test  we  seldom  found  parents  who  failed  to  complete  the 
questionnaire  because  of  a  language  problem—usually,  parents  simply 
had  someone  who  knew  mo.e  English  (often  the  student  or  one  of  his 
siblings)  help  them.    This  would  less  frequently  be  an  option  were  the 
student  sample  extended  to  non-English  speakers.    (It  is  also  unclear 
whether  questionnaires  filled  out  with  the  assistance  of  bilingual 
family  members  offer  data  of  a  quality  equivalent  to  questionnaires 
filled  out  in  the  parent's  mother  tongue.) 

Consultations  with  CES,  OBEMLA,  school  districts  with  large 
minority  language  populations,  the  National  Advisory  Panel,  and  the 
study  s  Hispanic  and  Asian-Pacific  supplement  consultants,  should 
clarify  the  general  isjue  of  the  possible  desirability  of  non-English 
language  contact  materials  and  instruments. 


7.4.2    Cognitive  Test  Battery 

The  NELS:88  cognitive  tests  must  fulfill  several  purposes.  They 
must  be  sensitive  to  achievement  gains  that  will  yield  reasonably 
reliable  estimates  in  each  of  the  four  content  areas  (mathematics, 
science,  English/reading,  social  studies).    Within  the  base  year  time 
constraints  (approximately  85  minutes  testing  time)  the  cognitive 
battery  must  minimize  both  floor  and  ceiling  effects.    The  tests  must 
be  curriculum-sensitive— that  is,  the  pool  of  achievement  items  must  be 
tied  to  curriculum  offerings  in  grades  8-12.    An  additional  purpose  is 
to  develop  IRT  scales  for  mathematics  and  possibly  reading  that  will 
permit  cross-sectional  comparison  of  the  High  School  and  Beyond  sample 
with  the  NELS:88  follow-up  participants. 


Pour  relatively  short  tests  have  been  constructed  from  the  larger 
field  test  item  pool,  indicating  a  preliminary  choice  of  20  reading,  40 
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mathematics,  30  social  studies,  and  25  science  items.  Preliminary 
results  suggest  that  for  mathematics  and  reading,  two  test  forms  should 
be  provided—on*  for  eighth  and  tenth  graders,  and  another  for  twelfth 
graders.    A  single  form  can       used  for  the  social  studies  test; 
further  analyses  will  determine  whether  a  single  form  will  suffice  for 
the  science  test. 

Preliminary  science,  mathematics  and  reading  test  forms  exhibit 
reliabilities  that  match  or  exceed  those  of  HS&B;  however,  the  social 
studies  tests,  while  reliable,  are  too  different  from  the  HS&B  social 
studies  tests  to  compare.    Additional  analyses  are  required  to 
supplement  these  preliminary  results  and  provide  a  basis  for  final 
recommendat  i  on  s • 


7.4.3      Teacher  and  School  Quest ioanaires 

While  overall  item  nonresponse  on  both  teacher  and  school 
questionnaires  was  quite  low,  analysis  pointed  to  a  number  of  specific 
item  or  format  modifications  that  should  reduce  nonresponse  further  in 
the  base  year  instruments. 

The  high  individual  and  item  response  for  these  instruments  is  all 
the  more  surprising  given  che  finding  that  they  are  of  a  length 
substantially  above  the  targeted  respondent  burden.    It  will  therefore 
be  necessary  to  identify  items  that  might  be  eliminated  so  that  the 
instruments  can  be  shortened— or  if  this  is  not  possible  without  harm 
to  the  research  goals  of  the  study,  to  provide  respondents  with  more 
accurate  expectations  as  to  questionnaire  length,  and  to  anticipate 
additional  retrieval  activities  in  the  base  year. 


7.4.4      Parent  Questionnaire 

In  general,  parents  appeared  to  welcome  the  opportunity  to 
complete  this  questionnaire.    Although  the  field  test  version  was 
somewhat  longer  than  intended  for  the  base  year,  because  of  the 
salience  and  interest  of  its  content  for  this  respondent  population, 
the  instrument  was  apparently  perceived  as  being  a  quite  reasonable 
length. 

A  criterion  of  a  minimum  95  percent  response  for  critical  items 
and  a  minimum  92  percent  response  for  noncritical  items  was  used  to 
identify  problematic  items.    Overall,  item  nonresponse  was  low,  for 
both  critical  and  noncritical  items.    There  were  however  some  high 
nonresponse  items,  owing  to  the  nature  of  the  question  (for  example, 
income)  or  to  problems  in  item  wording  and  format,  which  will  be 
corrected  for  the  base  year  version.    Cross-validational  analyses 
showed  that  parents  were  superior  reporters  of  parental  education  and 
occupation  data,  as  well  as  special  program  participation;  parents  were 
less  able  than  eighth  graders,  however,  to  name  the  likely  school  of 
attendance  in  the  tenth  grade. 
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These  results  confirm  the  prudence  of  sampling  all  parents  of* 
NBLS:88  eighth  graders.    A  slightly  shortened,  revised  version  of  the 
present  parent  questionnaire  should  serve  the  purposes  of  the  base  year 
well. 
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form  Approved 
0.P1.8.  No.  1850-0593 

EIGHTH  GRADE  LOCATOR  BOOKLET 

NELS:88 
NATIONAL  EDUCATION 
LONGITUDINAL 
STUDY  OF 
1988 
FIELD  TEST 


Prepared  for:  U.S.  Department  of  Education 

Center  for  Education  Statistics 

By:  NORC,   A  Social  Science  Research  Center 
University  of  Chicago 


BEGIN  DECK  01 
01-06/  (ID) 


As  a  natter  of  policy,  *,he  Center  for  Statistics  is  concerned  with  protecting  the  privacy  jf  individuals  ^no 
participate  in  voluntary  surveys     'Je  want  to  let  you  know  that- 

1  Section  436  of  the  General  Education  Provisions  Act  (23-USC  I22ie-1)  allows  us  to  ask  you  fe  questions  n 
this  questionnaire. 

2  You  may  skip  any  questions  you  Jo  not  wish  to  answer 

3  >*e  are  asking  you  these  questions  in  order  to  gather  information  aoout  wJ^at  haooens  t?  stuoents  as  t*ey 
move  out  of  high  school  and  ra><e  decisions  aoout  oostsecondarv  education  and  work 

4  vour  responses  will  be  merged  with  those  of  other  students,  and  the  answers  you  give  will  never  oe 
identified  as  yours. 
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GENERAL  INSTRUCTIONS 


PLEASE  READ  EACH  QUESTION  CAREFULLY 

It  ii  important  thaw  you  follow  the  directions  for  responding  to  each 
kind  of  question.    These  are: 

(CHICLE  ONE) 

fihat  is  the  color  of  your  eyes? 

(CIRCLE  ONE) 

Br0wn   1  If  the  color  of  your 

Blu*    2  *yes  is  green,  you 

Green  (3)  would  circle  the  three 

Another  Color    4  as  shown. 


(CIRCLE  ALL  THAT  APPLY) 

Last  week,  did  you  do  any  of  the  following? 

(CIRCLE  ALL  THAT  APPLY) 

a.  See  a  play   1  if  you  went  to  a  movie 

b.  Co  to  a  movie  <T)  and  attended  a  sport- 

c.  Attend  a  sporting  event  ing  event  last  week, 

you  would  circle  two 
items  as  shown. 


(CIRCLE  ONE  ON  EACH  LINE) 

Do  you  plan  to  do  any  of  the  following  next  week? 

(CIRCLE  ONE  ON    EACH  LINE) 

If  you  plan  to  study 
Yes  Not  Sure  No    at  a  friend's  house, 

a.  Visit  a  relative    1  ...  2  ....^  do  not  plan  to  visit  a 

b.  Go  co  a  museum   1  . .         . . .  3    relative,  and  are  not 

c.  Study  at  a  sure  about  going  to  a 

friend's  house   Q)***  2  ....  3    museum  next  week,  you 

would  circle  one  on 
each  line  as  shown. 


This  questionnaire  is  not  a  test.    We  hope  you  will  answer  every 
question,  but  you  may  skip  an>  question  you  do  not  wish  to  answer. 


416 


DECKS  01-0 


PART-1  YOUR  BACKGROUND 


1.    Please  print  in  your  name,  address,  and  telephone  number. 


NAME: 


Ust  07-26/ 


First  27-38/ 


Middle  39-48/ 


ADDRESS: 


ADDRESS 
CONTINUED: 


Number 


Street 


49-68/ 


Apartment  Number  07-26/ 


BEGIN 
DECK  02 


city  27-46/ 


State  47-6I/    Zip  C -de  62-66/ 


(If  you  don't  have  a  telephone,  check  this  box:    [  ]) 


67/ 


TELEPHONE: 


Area  Code    gg-70/  Telephone  Number  7^.77/ 


2.    Please  print  in  the  name  of  your  mother  or  female  guardian* 


MOTHER  OR  FEMALE 
GUARDIAN'S  NAME: 


BEGIN 
DECK  03 


Last  07-26/ 


First  27-38/  Middle  39-48/ 


(If  you  have  no  living  mother  or  female  guardian, 
check  this  box:  [   ]  and  SKIP  TO  Question  4,  next  page; 


ml 


DECKS  04-05 


3.  Please  print  in  your  mother  or  female  guardian's  nddress  and  telephone 
*  number. 

Same  as  mine    [  I  — >  00  TO  Question  4 

If  the  address  and  telephone  number  are  different,  please  fill 
in  the  space  below. 

ADDRESS: 


Number 


ADDRESS 
CONTINUED: 


Street 


51-70/ 

Apartment  Number  07-26/ 


50/ 


BEGIN 
DECK  04 


City 


27-46/ 


State  47-61/    Zip  Code  62-66/ 


(If  no  telephone,  check  this  box:    [  ]) 


67/ 


TELEPHONE: 


Area  Code  68_70/ 


Telephone  Number  71-77/ 


4.    Please  print  in  the  name  of  your  father  or  ma1  a  guardian. 

M 

FATHER  OR  MALE 
GUARDIAN'S  NAME 


BEGIN 
DECK  05 


Last 


07-26/ 


First  27-38/  Middle39-48/ 


(If  you  have  no  living  father  or  male  guardian, 
check  this  box:     [  ]  and  SKIP  TO  Question  6,  next  page) 


49/ 
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5*    What  is  your  father  or  male  guardian's  address  and  telephone  number? 
* 

Same  as  Nine    [  ]  — >  00  TO  Question  6  ^q/ 

If  the  address  and  telephone  number  are  different,  please  fill  in 
the  space  below. 

ADDRESS: 

Number  Street  51-70/ 

ADDRESS  BtUiN 

CONTINUED:     DECK  06 

Apartment  Number  07-26/ 


City  27-46/  State   47-61/    Zip  Code  62-66/ 

(If  no  telephone,  check  this  box:    [  ])  67/ 


TELEPHONE: 


Area  Code  68-70/ 


Telephone  Number  71-77/ 


6.    Which  of  the  following  people  live  in  the  same  household  with  you? 

(CIRCLE  ALL  THAT  APPLY) 
a*  Father  .  *  ♦  

b.  Other  male  guardian  (stepfather  or  foster  father)   

c.  Mother   

d.  Other  female  guardian  (stepmother  or  foster  mother)  •••• 

e.  Brother(s)  and/or  sister(s) 
(including  step-  or  half-?   


f.  Crandparent(s)   

g.  Other  relative(s)  (children  or  adults) 

h.  Non-relat ive( s)  (children  or  adults)  .< 


BEGIN 

deck  o: 


07/ 
08/ 
09/ 
10/ 

11/ 
12/ 
13/ 
14/ 
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DECKS  07-08 


The  information  in  the  next  question  will  help  us  to  get  in  touch  with  you  ir  the 
future.  This  information  will  be  kept  in  strict  confidence  and  will  only  b~  used 
for  survey  purposes. 

7.    Please  write  in  the  name,  address  and  telephone  number  of  your  family's 
*       closest  relative  or  friend  who  does  not  live  with  you. 


NAME: 


ADDRESS: 


ADDRESS 
CONTINUED: 


Last 


Number 


15-34/ 


First     35.46/    Middle  47-56/ 


Street 


57-76/  BEGIN 

DECK  08 


Apartment  Number  Q7-26/ 


City 


27-46/ 


State    47-61/    Zip  Code  62-66/ 


TELEPHONE  (if  known): 


Area  Code  67-69/ 


Telephone  Number  70-76/ 


Is  this  person  a  relative  or  a  friend?    (CIRCLE  ONE) 
Relative  1  Friend  2 


77/ 
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8.  Do  you  have  a  nickname  or  another  name  which  your  friends,  neighbors,  or 
»       family  call  you? 


(CIRCLE  ONE) 


Yes 
No  . 


1  — >  GO  TO  A 

2  — >  GO  TO  Question  9 


A.  If  you  answered  yes,  what  is  your  nickname  or  other  name?  Please  print 
*  below. 


NICKNAME: 


9.  When  were  you  born? 
m 


10.  What  is  your  sex? 
u 


Male  . 
Female 


08-27/ 


l_l_l  l_l_l 
MONTH        DAY  YEAR 

28-29/    30-31/  32-33/ 


(CIRCLE  ONE) 
.....  1 
  2 


BEGIN 
DECK  09 

07/ 


34/ 


11.  What  is  the  name  of  the  high  school  that  you  expect  to  be  attending  in 
*       tenth  grade? 


Name 


City 


(PLEASE  PRINT  FULL  NAME  OF  SCHOOL) 
  State 


07-26/ 

12.  Is  it  a  public  school,  a  private  religious  school,  or  a  private 
non-religious  school? 

(CIRCLE  ONE) 

Public    1 

Private  religious  ••••2 
Private  non-religious  3 
Don't  know  8 


35-64/ 


27-41/ 


BEGIN 
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13.  What  kind  of  school  is  it: 

(CIRCLE  0MB) 

General  or  comprehensive  high  school  43/ 
(general  program  or  all  sorts  of  programs)    1 

College  preparatory  high  school    2 

Trade,  technical  or  vocational  high  school    3 

Other:     (WRITE  IH)_  A 

I  don't  know    8 

14.  Is  there  another  high  school  that  you  may  go  to  instead? 

(CIRCLE  ONE) 

No    1  — >  SKIP  TO  Question  16,  next  page  44/ 

Yes    2  -  If  yes,  what  is  the  name  of  this  school? 

Name  

(PLEASE  PRINT  FULL  NAME  OF  SCHOOL)  , 

45-74/ 

City  State   BEGIN 

07-26/  27-41/  DECK  11 

15.  Is  this  a  public  school,  a  private  religious  school,  or  a  private 

non-religious  school? 

(CIRCLE  ONE) 

Public    1  42/ 

Private  religious    2 

Private  non-religious    3 

Don't  know   6 


6 
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The  following  questions  are  about  the  language  or  languages  spoken 
by  you  and  your  family, 

16*  Before  you  started  going  to  school,  did  you  speak  any  language  other 
than  English? 

(CIRCLE  OMB) 

Yes    1  — >  CO  TO  Question  17  4V 

No    2  —>  SKIP  TO  Page  9,  Question  19 


17.  What  was  the  first  language  you  spoke  when  you  were  a  child? 

(CIRCLE  ONE) 


English   .  01  44-45/ 

Spanish    02 

Italian  '   03 

Chinese    04 

French    05 

German    Ofc 

Japanese    07 

Korean  ,   08 

Portuguese   09 


Any  Filipino  language  ....  10 
Other  (WRITE  IN  BELOW)  ...  11 


7 
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18.  What  OTHER  language  did  you  speak  before  you  started  going  to  school? 

(CIRCLE  OMR) 

I  spoke  no  other  language    00  46-47/ 

I  also  spoke: 

English  01 

Spanish   02 

Italian   03 

Chinese   04 

Prench  05 

German   06 

Japanese  07 

Korean   08 

Portuguese   09 

Any  Filipino  language  ••••  10 

Other  (WRITE  III  BELOW)  ...  11 


8 
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19.  What  language  do  you  USUALLY  speak  NOW? 

(CIRCLE  ONE)  - 


English    01  48-49/ 

Spanish    02 

Italian    03 

Chinese    04 

French   05 

German    06 

Japanese    07 

Korean   08 

Portuguese    09 


Any  Filipino  language  ....  10 
Other  (WRITE  IM  BELOW)  ...  11 


9 
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20.  Is  any  language  other  than  English  spoken  in  your  home? 
ii 

(CIRCLE  OMB) 

Yes   ,   1  — >  00  TO  Question  21 

No    2  — >  Please  SKIP  TO  Page  1  of  the 

Main  Questionnaire 


50/ 


21.  What  language  do  the  people  in  your  home  USUALLY  speak? 
ii 

(CIRCLE  ONE) 


English    01  51-52/ 

Spanish    02 

Italian    03 

Chinese   «•  04 

French    05 

German    06 

Japanese    07 

Korean    08 

Portuguese    09 


Any  Filipino  language  10 
Other  (WRITE  7N  BELOW)  ...  11 


10 
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22.  What  OTHER  language  is  spoken  in  your  home? 

(CIRCLE  ONE) 
No  other  language  is  spoken  ....  00 
The  other  language  spoken  is: 


English    01  53-54/ 

Spanish   02 

Italian   03 

Chinese    04 

French   05 

German   06 

Japanese   07 

Korean   08 


Portuguese  09 

Any  Filipino  language  ....  10 
Other  (WRITE  IM  BELOW)  ...  11 


11 
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23.    What  language,  other  than  English,  do  you  currently  use  most  often? 

( CIRCLE  OMB) 

Spanish    02  55-56/ 

Italian    03  57-64/R 

Chinese   04 

French    05 

German    06 

Japanese    07 

Korean   08 

Portuguese    09 

Any  Filipino  language  ..  .  10 
Other  (WRITE  IV  BELOW )  ...  11 


QUESTIONS  24  AND  25  BELOW  ARE  ABOUT  THE  USE  OF  THE  LANGUAGE  YOU  ANSWERED  IN 
QUESTION  23. 


24.  With  regard  to  THA 


How  well  dr  you  • • , 


JAGE  hov  well  do  you  do  the  following? 
(CIRCLE  ONE  ON  EACH  LINE) 


Very 
Well 


Pretty 
Well 


Well 


a.  Understand  that 
language  when 

people  speak  it    1   2   3 

b.  Speak  that  language  . 1   2   3 

c.  Read  that  language  ....  1   2   3 

d.  Write  that  language  ...  1   2   3 


Not  Very 
Well 


Not  At 
All 


4  ..*>.*...  5 
4  ««««v"f«.  5 
A    5 


65/ 
66/ 
67/ 
68/ 


12 
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25*  How  often  is  THAT  LANGUAGE  spoken  in  each  situation  listed  below? 

(IP  YOU  DO  MOT  SEE  THAT  PERSON  OFTEN,  PLEASE  CIRCLE  "Does  not  apply") 

(CIRCLE  ONE  Oil  EACH  LIME) 

Always  or  About  Does 

most  of  half  the  Not 

the  time  time  Sometimes    Never  Apply 

How  often  do  (does): 

a.  YOU  speak  that  language 
to  your  mother  (or  female 

guardian)    1    2    3    4    5  69/ 

b.  Your  MOTHER  (or  female 
guardian)  speaks  that 

language  to  you    1    2    3  4  5  7**' 

c*  YOU  speak  that  language 
to  your  father  (or  male 

guardian)    1    2    3  4  5  71/ 

d.  Your  FATHER  (or  male 
guardian)  speaks  that 

language  to  you   1    2    3   4   I  72/ 

e.  Your  PARENTS  (c-  guardians) 
speak  that  language 

co  each  other   1    2    3    4    5  73/ 

f.  Your  GRANDPARENTS 
speak  that  language 

to  you    1    2    3    4    5  74/ 

g.  Your  BROTHERS  or 
SISTERS  speak  that 

1'  guage  to  you  ...  (   1    2    3    4    5  75/ 

h.  YOU  speak  that  language 
with  your  best  friends 

in  your  neighborhood  ....    1   ,..  2    3    4    5  76/ 

i.  YOU  speak  that  language 
with  your  best  friends 

in  school   1    2    3   4   5         11 1 


13 
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26.  How  well  do  you  do  the  following? 

(CIRCLE  OMB  ON  BACH  LIMB) 

Not 

Very  Pretty  Very 
Well         Well  Well  Well 

How  well  do  you  .. . 

a.  Understand  spoken  English  ,  1    2    3    4  07/ 

b.  Speak  English    1    2    3    4  08/ 

c.  Read  English    1   2    3   4  09/ 

d.  Write  English    1   2    3   4  10/ 


14 


430 


ERJC 


DECK  12 


27.  During  your  first  two  years  in  school  in  the  United  States,  were  any  of 
the  following  subjects  taught  to  you  in  a  language  other  than  English? 
Do  not  include  regular  foreign  language  classes* 

IF  HIS  IS  YOUR  FIRST  YEAR  IN  THE  UNITED  STATES  ANSWER  FOR  THIS  YEAR  ONLY* 

(CIRCLE  ONE  ON  EACH  LINE) 


Yes 


a.  Math  ... 

b.  Science 


United  States  literature  or  language 
such  as  reading  or  writing   


d.  United  States  history,  government 
or  social  studies   


Literature  or  language  arts  from 
the  culture  your  ancestors  came  from 


f.  History,  government  or  social  studies  from 
the  culture  your  ancestors  came  from   


No 
2  , 
2  , 


Subject 
Not  Taught 


3 
3 


11/ 
12/ 

13/ 

14/ 
15/ 

16/ 


28.  Were  you  ever  enrolled  in  an  English  language/language  assistance 

program,  that  is,  a  program  for  students  whose  native  language  is  not 
English? 

(CIRCLE  ONE) 

Ye?    1  — >  GO  TO  Question  29 

No   2  —  >  Please  SKIP  TO  Page  1 

of  the  Main  Questionnaire 


17/ 


29.  In  which  grade(s)  were  you  enrolled  in  this  type  of  program? 

(CIRCLE  ALL  THAT  APPLY) 

1st  grade    1    18/      5th  grade    1  22/ 

2nd  grade    1    19/      6th  grade    1  23/ 

3rd  grade    1    20/      7th  grade    1  24/ 

4th  grade    1    21/      8th  grade    1  25/ 


PLEASE  GO  OH  TO  THE  MAIM  QUESTIONNAIRE  BOOKLET 

15 
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Eighth  Grade  Questionnaire 


EIGHTH  GRADE  QUESTIONNAIRE 


Form  Approved 

O.M  9.  No.  1950-355 

App.  Exp..  6/50/19* 


NELS:88 
NATIONAL  EDUCATION 
LONGITUDINAL 
STUDY  OF 
1988 
FIELD  TEST 


Prepared  for:  U.S.  Department  of  Education 

Center  for  Education  Statistics 

By:  NORC,  A  Social  Science  Research  Center 
University  of  Chicago 


BEGIN 
DECK  13 


01-06/  (: 


As  a  matter  of  policy,  the  Center  -zr  Statistics  is  concerned  with  protecting  the  privacy  of  individuals  ~ho 
participate  in  voluntary  surveys.    ,e  want  to  let  you  know  that: 

1.  Section  406  of  the  General  Eolation  Provisions  Act  (20-USC  I22le-1)  allows  us  to  ask  you  the  questions  in 
this  questionnaire. 

2.  You  may  sf/ip  any  questions  ,ou      not  wish  to  answer. 

3.  We  are  asking  you  these  questions  n  order  to  gather  information  about  what  happens  to  students  as  cney 
ftove  out  of  high  school  and  ^e  decisions  about  postsecondary  education  and  work. 

4.  Your  -esponses  will  be  merged  -ith  those  of  other  students,  and  the  answers  you  give  will  r*ver  be 
identified  as  vours. 


4,33 


GENERAL  INSTRUCTIONS 


PLEASE  READ  EACH  QUESTION  CAREFULLY 

It  is  important  that  you  follow  the  directions  for  responding  to  each 
kind  of  question.    These  ere: 

(CIRCLE  ONE) 

Whet  is  the  color  of  your  eyes? 

(CIRCLE  ONE) 

Brown   1 

Blue    2 

Green  (J) 

Another  Color    4 


(CIRCLE  ALL  THAT  APPLY) 

Lest  week,  did  you  do  eny  of  the  following? 

(CIRCLE  ALL  THAT  APPLY) 

a.  Sec  «  play  .   1  if  y0u  went  to  *  nrvie 

b.  Go  to  a  movie   <J")  and  attended  a  sport- 

c.  Attend  a  sporting  event  ....{^  ing  event  last  week, 

you  would  circle  two 
items  as  shown. 

(CIRCLE  ONE  ON  EACH  LINE) 

Do  you  plan  to  do  any  of  the  following  next  week? 

(CIRCLE  ONE  ON    BACH  LINE) 

If  you  plan  to  study 
Yes  Not  Sure  No    at  a  friend's  house, 


a.  Visit  a  relative   1  ...  2  do  not  plan  to  visit  a 

b.  Go  to  a  museum   1  ..^3}....  3    relative,  and  are  not 

c.  Study  at  a  sure  about  going  to  a 

friend's  houie  Qj...  2  ••••  3    museum  next  week,  you 

would  circle  one  on 
each  line  as  shown. 


This  questionnaire  is  not  a  test.    We  hope  you  will  answer  every 
question,  but  you  may  skip  any  questio-  vou  do  not  wish  to  answer. 


If  the  color  of  your 
eyes  is  green,  you 
would  circle  the  three 
as  shown. 
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PART-1  YOUR  FAMILY 

Next  we  would  like  to  ask  you  some  background  information. 

I.    We  would  like  to  ask  you  about  the  area  of  the  world  your  ancestors 

»       lived  in  BEFORE  coning  to  America.    What  do  you  consider  your  background? 

If  your  ancestors  came  from  more  than  one  area,  please  circle  below  the  one 

area  you  consider  the  most  important  part  of  your  background. 

(CIRCLE  OME) 

HISPANIC  OR  SPANISH 

Mexican    01 

....................  07-08/ 

Cuban   02 

Puerto  Rican    03 

Other  Hispanic  (WRITE  IN)   04 

ASIAN  OR  PACIFIC  ISLANDER 

Chinese    05 

Filipino   „   06 

Japanese    07 

Korean   08 

Southeast  Asian 
(Vi  etncmese,  Laotian,  Cambodian/Kampuchean,  etc.)  ...  09 

Pacific  Islander   ,   10 

Other  Asian  (WRITE  IN)  11 

.  NEITHER  HISPANIC  NOR  ASIAN  OR  PACIFIC  ISLANDER    12 
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2.  What  is  your  race? 
ft 

(CIRCLE  ONE) 

Black   1  09/ 

White   2 

American  Indian  or  Alaskan  Native    3 

Asian  or  Pacific  Islander    4 

Other  5 

3.  About  how  many  students  in  your  grade  are  •  •  • 

(CIRCLE  (MB  OH  EACH  LIME) 
None     A  Few     About  Half       Most  All 

a.  Black?   0  1    2   3  4  10/ 

b.  Hispanic  or  Spanish?   0   1    2  3  4  11/ 

c.  Asian  or  Pacific  Islander?  •  0  1    2  3  4  12/ 

4.  Were  you  born  in  the  United  States  (that  is,  any  of  the  fifty  states,  or 

the  District  of  Columbia)  in  Puerto  Rico  or  in  another  country  or  area? 

(CIRCLE  ONE) 

I  was  born  in  the  United  Spates  . ...  1  — >  SKIP  TO  Question  7,  next  page  13/ 

I  was  born  in  Puerto  Rico   2  — >  GO  TO  Question  5,  next  page 

I  was  born  in  another  country/area  •  3  — >  GO  TO  Question  5,  next  page 
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5*    How  old  were  you  when  you  first  came  to  the  fifty  states  or  the  District 
of  Columbia? 

(CIRCLE  OMB) 

Age  Age 

1  year  old  or  less  ..•01  9  years  old    09  14-15/ 

2  years  old  02  10  years  old    10 

3  year  ;  old  03  11  years  old    11 

4  years  old  04  12  years  old    12 

5  years  old  05  13  years  old   13 

6  years  old   06  14  years  old    14 

7  years  old  07  15  years  old    15 

8  years  old  08  16  years  old  or  older  16 

6.  What  grade  were  you  placed  in  when  you  arrived  in  the  fifty  states  or 

the  District  of  Columbia  for  the  first  time? 

(CIRCLE  ONE) 

Arri"*d  before 

School  age    09  Fourth  grade   04  16~17 

Kindergarten    00  Fifth  grade  , ...  05 

First  grade   01  Sixth  grade    06 

Second  grade    02  Seventh  grade    07 

Third  grade    03  Eighth  grade    08 

7.  Have  you  completed  any  grades  in  schools  outside  the  fifty  states  or  the 

District  of  Columbia? 

(CIRCLE  ONE) 

Yes    1  — >  GO  TO  Question  8,  next  page  13/ 

No  . .  ,  2  — >  SKIP  TO  Question  9,  next  page 


4 
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8.    Which  grades  have  you  completed  outside  the  United  States? 

(CIRCLE  ALL  THAT  APPLY) 


Third  grada    1 

Fourth  grade    1 


19/ 

23/ 

20/ 

24/ 

21/ 

25/ 

22/ 

26/ 

9*  Do  you  or  have  you  received  special  services  for  any  or  all  of  the  following 
■  conditions? 

(CIRCLE  OMS  ON  EACH  LIME) 
Yes  No 

a*  A  problem  with  your  vision 

(not  corrected  with  glasses)    1    2  27/ 

b.  Hearing  problem   1    2  28/ 

c.  Deafness    1    2  29/ 

d.  Speech  problem    1    2  30/ 

e.  Orthopedically  impaired 

(for  example,  club  foot,  absence 
of  arm  or  leg,  cerebral  palsy, 

amputation,  polio)    1   2  31/ 

f.  specific  learning  disability 

(for  example,  imperfect  ability  to 
listen,  think,  speak,  read,  write, 
spell,  or  do  mathematical 

calculations)    1    2  32/ 

g.  Other  major  health  problem 

(WRITE  III  BELOW)   1    2  33/ 


5 
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How  many  brothers  and  sisters  do  you  have?  Please  include  any  stepbrothers 
and/or  stepsisters  if  they  live  or  have  lived  in  your  home. 


(CIuUE  ONE) 

None    0 

One   t  m   i 

Two    #  #  2 

Three  ,   3 

Pour   5  #  #  #  #  4 

Five  . ...   5 

Six  or  more    $ 


How  many  of  your  brothers  ar.a  sisters  art  cider  than  you  are?  Please 
include  any  stepbro.thers  and  sr  .  sisters  if  they  live  or  have  livH  in 
your  home. 

(CIRCLE  ONE) 
None  • «  0 

One  *  ##  1 

Two   .  „ . . .  2 

Three   ##  3 


Pour    4 

Five   ####  5 

Six  or  mo-e    6 
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12*    What  is  your  father's  (or  male  guardian's)  job  and  what  is  your  mother's  or 
(ftmalt  guardian's)  job?    Give  as  much  detail  as  possible.    For  example,  if 
your  father  is  a  writer,  tell  whether  he  writes  books,  newspaper  or  magazine 
articles  or  if  he  is  a  technical  writer  who  writes  car  instruction  manuals 
for  instance*    If  your  mother  works  as  a  teacher f  tell  us  what  kind  of 
school  she  works  tor  (such  as  a  eiementary,  high  school,  university). 

Pather  (or  male  guardian) 

Name  cf  Occupation  

Describe  what  he  does  

Name  cf  employer  

What  does  the  company  make  or  >lo  

Mother  (or  female  guardian) 

Name  of  Occupation  

Describe  what  she  does  

Name  of  employer  

What  does  the  company  make  or  do 
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13.  Which  of  the  categories  below  come  closest  to  describing  these  jobs? 
»        (CIRCLE  ONE  FOR  YOUR  FATHER'S  JOB  AND  ONE  FOR  YOUR  MOTHER'S  JOB.) 


a. 
Father 
(or  male 
guardian) 


b. 
Mother 
(or  female 
guardian) 


CLERICAL  such  as  bank  teller,  bookkeeper,  36-37/  38-39/ 
secretary,  typist,  mail  carrier,  ticket  agent    01    01 

CRAFTSPERSON  such  as  baker,  automobile  mechanic, 
machinist,  painter,  plumber,  telephone  installer, 

carpenter   02   02 

FARMER,  FARM  MANAGES    03  03 

HOMEMAKER  OR  HOUSEWIFE  ONLY    04   04 

LABORER  such  as  construction  worker,  car  washer, 

sanitary  worker,  farm  laborer    05   05 

MANAGER,  ADMINISTRATOR  such  as  sales  manager,  office 
manager,  school  administrator,  ouyer,  restaurant 

manager,  government  official   06   06 

MILITARY  such  as  career  officer,  enlisted  nia*  or 

woman  in  the  Armed  Forces    07   07 

OPERATIVE  such  as  mea.  cucter,  assembler,  machine 

operator,  welaer;  taxicab,  bus,  or  truck  driver    08    08 


Continued,  next  page  > 
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13.  Continued 


Father  Mother 

(or  male       (or  female 

guardian)  guardian) 


PROFESSIONAL  such  as  accountant,  artist,  registered         36"37  /  38-39  / 

nurst,  engineer,  librarian,  writer,  social  worker, 

actor,  actress,  athlete,  politician,  but  not  including 

school  teacher    09  09 

PROFESSIONAL  such  as  clergyman,  dentist,  physician, 

lawyer,  scientist,  college  teacher    10  ........  10 

PROPRIETOR  OR  OWNER  such  as  owner  of  a  small  business, 

contractor,  restaurant  owner    11    H 

PROTECTIVE  SERVICE  such  as  detactive,  police  officer  or 

guard,  sheriff,  *ire  fighter   ♦   12    12 

SALES  such  as  salesperson,  advertising  or  insurance 

agent,  real  estate  broker   „   13    13 

SCHOOL  TEACHER  such  as  elementary  or  secondary    14    14 

SERVICE  such  as  barber,  beautician,  practical 

nurse,  private  household  worker,  janitor,  waiter    15    15 

TECHNICAL  such  as  draftsman,  medical  or  dental 

technician,  computer  programmer    16    7  6 

Never  worked    17    17 

Don't  know   98    98 
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14.  What  was  ch«  highest  level  of  education  your  father  (stepfather  or  male 

guardian)  and  your  mother  (stepmother  or  female  guardian)  completed? 

(CIRCLE  ONE)  (CIRCLE  (WE) 

a.  b. 

Father  Mother 

(or  male  (or  ferrale 

gu  ard  i  an )  guard  i  an ) 

40-4* '  42-43/ 
Less  than  high  school  diploma    01  •  -  01 

High  school  diploma    02   02 

Vocational,  trade,  or  business  school 
after  high  school 

Less  than  two  years  .  03  03 

Two  yea  it  J  or  more    04   04 

College  program 

Less  than  two  years  of  college    05   05 

Two  or  more  years  of  college 

(including  two  year  degree)    06   06 

Finished  college 

(  oui-  or  five-year  degree)    07   07 

Master's  degree  or  equivalent    08   08 

Ph.D.,  M.D.,  or  or  ier  advanced 

professional  degree    09   09 

Don't  know    98   98 

15.  How  many  rooms  are  r.here  in  your  home?    Count  only  the  rooms  your  family 
lives  in.     Family  may  include  grandparents  and  other  relatives  if  they  live 
in  your  home.    Count  the  kitchen  (if  separate)  but  NOT  bathrooms. 

(CIRCLE  ONE) 

01    02    03    04    05    06    07    08    09      10  or  more  44-45/ 


9 
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16.  Which  of  the  following  does  your  family  have  in  your  home? 

(CIRCLE  OMB  OK  BACH  LIMB) 


Have                       Do  not  have 

a.  A  specific  pUce  for  study?    1    2  46/ 

b.  A  daily  newspaper?    1    2 

c.  An  encyclopedia?    1    2  4V 

d.  An  atlas?    1   2  49/ 

s.  A  dictionary?    1   2  50/ 

f.  Typewriter?    X    2  51/ 

g.  Computer?    \    2  52/ 

h.  Electric  dishwasher?    1    2  53/ 

i  •  TWo  or  more  cars  or 

trucks  that  run?  ,   1    2  54/ 

j.  More  than  50  books?    1    2  55/ 

k.  And  do  you  have  a  room  of  your  own?.  1    2  56/ 


17.  Since  the  beginning  of  the  school  year,  how  often  have  you  discussed  the 
following  with  either  or  both  of  your  parents  or  guardians: 

(CIRCLE  OME  OM  EACH  LIME) 


Three 

Once 

or 

at 

or 

more 

all 

twice 

times 

a.  Selecting  courses  or  programs 

at  school   1    2    3  57/ 

b.  School  activities  or  events  of 

particular  interest  to  you   ]    2    3  58/ 

c.  Things  you've  studied  in  class    1    2    3  59/ 


9 
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18.  Since  the  beginning  of  this  school  ye*r,  has  either  of  your  parents  or 
guardians  done  any  of  the  following: 


(CIRCLE  OMB  OH  BACH  LIME} 
Ye j  No       I  don't  know 


a.  Attended  a  school 
meeting   

b.  Phoned  or  spoken  to 
your  teacher  or 
counselor   ,  

c.  Visited  your  classes   

d.  Attended  a  school  event 
such  as  a  play,  concert, 
gym  exhibit,  sports 
competition,  honor  ceremony 
or  science  fair  where  YOU 
participated   


1   2    8  6°/ 

1    2    8  61/ 

1    2    8  62/ 

1    2    8  63/ 


19.  How  often  do  your  PARENTS  or  guardians  do  the  following: 


(CIRCLE  ONE  Oil  EACH  -J HE) 


Often       Sometimes     Rarely  Never 

a.  Check  on  whether 
you  have  done  your 

homework    1    2  ........  3    4  64/ 

b.  Require  you  to  do  work 

or  chores  around  tha  home   1    2    3    4  65/ 

c.  Limit  the  amount  of 

time  you  can  spend  watching  TV    1    2    3    4  66^ 
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29.  How  much  do  you  take  part  in  decisions  that  affect  you?  (For  example,  which 
student  clubs  or  activities  you  will  take  part  in,  or  how  late  you  will  stay 
out  . ) 

(CIRCLE  OMB) 

Very  much    1  j 

Much    2 

Some    3 

None  at  all   4 


21.  Are  the  following  statements  mostly  t  jc  for  you  and  your  parents,  or 
mostly  false  for  you  and  your  parents? 

(CIRCLE  OMB  OM  BACH  LIMB) 
True  Palce 

a.  My  parents  trust  me  to  do  what  they 

expect  without  checking  up  on  me    1   2  68/ 

b.  I  often  do  not  know  WHY  I  am 
supposed  to  do  what  my  parents 

tell  me  to  do   1    2  69/ 

c.  I  often  count  on  my  parents 
to  solve  many  of  my  problems 

for  me    1    2  70/ 


22.  How  much  time,  on  an  average  school  day,  do  you  spend  at  home  after 
school  with  no  adult  present? 

(CIRCLE  ONE) 


None — r.ever  happens    1  71/ 

Less  than  1  hour    2 

1-2  hours    3 

2*3  hours   4 

More  than  3  hours    5 
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23.  How  itjny  hours  a  day  do  you  USUALLY  watch  TV? 

a.  b. 

HOURS  PER  DAY  On  weekdays  On  weekends 

(Circle  One  (Circle  One 
Below)  Below) 

72/  73/ 
Don't  watch  TV  0  .«  0 

Less  than  one  hour  a  day  s  1    1 

1-  2  hours   2    2 

2-  3  hours   3    3 

3-  4  hours   4  . . .  „   4 

4-  5  hours   ♦  5  .  t   5 

Over  5  hours  a  day  6    6 


24i  How  many  cigarettes  do  you  usually  smoke  in  a  day? 

(CIRCLE  OUR) 
Don't  smoke   0 

1  to  5  cigarettes  a  day   1 

About  1/2  pack  a  day   2 

About  1  pack  a  day   3 

About  1  and  1/2  packs  a  day   4 

2  or  more  packs  a  day    5 


14 
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PART-2  YOUR  OPINIONS  ABOUT  YOURSELF 

25.    How  do  you  feel  about  each  of  the  following  statements? 

(CIRCLE  OMB  ON  BACH  LINE) 

Agree  Disagree 
strongly     Agree      Di  sagree  strongly 

a.  I  feel  good  about  myself   1    2    3    4  07/ 

b.  I  don't  have  enough 
control  over  the 
direction  my  life 

is  taking    \    2    3    4  08/ 

c.  In  my  life,  good  luck  is 
more  important  than  hard 

work  for  success    1    2    3    4  09/ 

d.  I  feel  I  am  a  person  of 
worth,  the  equal  of  other 

people   1    2  3   4  10/ 

e.  I  am  able  to  do  things 
as  well  as  most  other 

people    1    2    3  4  11/ 

f.  Every  time  I  try  to  get 
ahead,  something  or 

somebody  stops  me    1    2   3   4  12/ 

g.  My  plans  hardly  ever 
work  out,  so  planning 
only  makes  me 

unhappy   1    2    3   4  13/ 

h.  I  try  to  accept  my 
condition  in  life, 
rather  than  try  to 

change  things    1    2   3   4  14/ 

i.  On  the  whole,  I  am 
satisfied  with 

myself   1    2   3  4  15/ 

j.  I  certainly  feel 

useless  at  times   1    2   3   4  ig/ 


Cont .  next  page 
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I  have  a  big  influence 
over  the  things  thit 
happen  to  me   


At  times  I  think  I 
am  no  good  at  all  , 


When  I  make  plans,  I  am 
alno*t  certain  I  can 
make  them  work   


I  feel  I  do  not  have 
much  to  be  proud  of  . 


What  happen*  to  me  is 

my  own  doinj   


I  feel  that  I  have  a 
number  of  good  qualities 

Chance  and  luck  are 
very  important  for  what 
happens  in  my  life   


I  wish  I  could  have 
more  respect  far 
myself   


(CIRCLE  ONE  ON  EACH  LIME) 

Agree  Disagree 
strongly     Agree      Disagree  strongly 


All  in  all,  I  pretty 
much  feel  that  I  am  a 
failure   


17/ 
18/ 

19/ 
20/ 
21/ 
22/ 

23/ 

24/ 

25/ 
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PART-3  YOUR  PLANS  FOR  THE  FUTURE 
As  things  stanu  now,  how  far  in  school  do  you  think  you  will  get? 

(CIRCLE  ONE) 


Won't  finish  high  school    1 

Will  graduate  from  high  school, 

but  won't  go  any  farther    2 

Will  go  to  vocational,  trade, 
or  business  school 

after  high  school    3 

College  —     Will  attend  college    A 

Will  graduate  from  college    5 

Will  attend  a  higher  level 
of  school  after  graduating 
from  college    6 


How  far  in  school  do  you  think  your  patents  (guardians)  want  you  to  go? 

a.  b . 

(CIRCLE  ONE)  (CIRCLE  ONE) 
Father  Mother 
(or  male       (or  female 
guardian)  guardian) 

27/  28/ 

Less  than  high  school 

graduation    1    1 

Graduate  from  high  school, 

but  not  go  any  farther    2    2 

Go  to  vocational,  trade, 
or  business  school  after 

high  school    3    3 

College  —    Attend  college    4    4 

Graduate  from  college    5    5 

Attend  a  higher  level  of 
school  after  graduating 

from  college   , .  6    6 

Don't  know   8    8 
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28.  In  which  of  the  following  types  of  programs  do  you  expect  to  enroll  in 
high  school? 

(CIRCLE  ONE) 

Academic  or  college  preparatory    1  29/ 

Vocational  (trade)    2 

General    3 

Other  (WRITE  IN)  4 

I  don't  know   8 

29.  How  often  have  you  talked  to  the  following  people  about  planning  your 
high  school  program? 

(CIRCLE  ONE  Oil  EACH  LIME) 

Once  or  Three  or 

Not  at  all  twice  more  times 


a.  Your  father 

(or  male  guardian)  0 

b.  Your  mother 

(or  female  guardian)  •  0 

c.  A  guidance  counselor  •  0 

d.  Teachers   0 

e.  Friends  or  relatives 
about  your  own  age  • • •  0 


2 


30/ 
31/ 


2  32/ 
2  33/ 

2  34/ 
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30.    Since  cht  beginning  of  this  school  year,  how  often  have  you  talked  to  a 
counselor  at  your  school,  for  any  of  the  following  reasons: 

(CIRCLE  ONE  ON  EACH  LINE) 

3  or  more 
Never     Once     Twice       t  imes 


a.  To  get  information  about 
high  schools  and  high 
school  programs   

b.  To  g#t  information  about 
jobs  or  careers  that  you 
ought  be  interested  in 
after  finishing  school  • 

c.  To  help  improve  your 
academic  work  in  school 
right  now   

d.  Because  ot  discipline 
problems   

e.  To  get  counseling  on 
alcohol  or  drug  abuse 
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0  ••••  1  ••••  2                 3  35/ 

0  ....  1  ....  2  3  36/ 

0  ••••  1  ••••  2                 3  27 1 

0  ....  1  . . • .  2  .......  3  38/ 

0  ....  1  ....  2  .......  3  J 
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31.  S;nce  the  start  of  this  school  year  have  ycu  received  any  information 
on  vocational  education? 

(CIRCLE  OMB) 

Ye»    1  — >  GO  TO  Question  32  40/ 

No    2  — >  SKIP  TO  Question  33 

32.  How  did  you  get  this  information? 

(CIRCLE  ALL  THAT  APPLY) 

a.  Special  course  on  careers  .-.   i  41/ 

b.  Special  counseling    1  42/ 

c.  Written  descriptions  of 

course    or  programs  to  take  home   1  43/ 


d.  Other  (WRITE  IN) 


44/ 


33.    Have  you  taken  any  special  test  that  would  indicate  your  aptitude 

(potential  talent  or  capability)  for  a  particular  career  and/or  job? 

(CIRCLE  ONE) 

Y*9    1  .',5/ 

No    2 

I  don't  know    8 
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34*    What  kind  of  work  will  you  be  doing  w.  en  you  are  30  years  old?  (CIRCLE 
THE  ANSWER  THAT  COMES  CLOSEST  TO  WHAT  YOU  EXPECT  TO  BE  XING.) 


(CIRCLE  ONE) 

CRAFTSPERSON  OR  OPERATOR  such  as  baker,  mechanic,  cook, 
machine  operator,  clothing  presser,  bus  driver,  taxi  driver, 

truck  driver  ,   01  46-47/ 


FARMER  OR  FARM  MANAGER    02 

HOUSEWIFE/HOMEMAKER   03 

LABORER  OR  FARM  WORKER  such  as  farm  hand, 
garbage  collector,  car  washer, 

construction  worker    OA 

MILITARY,  POLICE,  OR  SECURITY  OFFICER  such  as  career  officer 

or  enlisted  person  in  The  armed  forces,  police  officer, 

security  guard,  firefighter,  detective    05 

PROFESSION,  BUSINESS,  OR  MANAGERIAL 
such  as    professor,  teacher,  librarian, 
nurse,  doctor,  dentist,  restaurant  manager, 

buyer,  business  executive    06 

OWNER  such  as  owner  of  business  or  service  ,  07 

TECHNICAL  such  as  draftsman,  medical 

or  dental  technician,  computer  programmer    08 

SALESPERSON,  CLERICAL  OR  OFFICE  WORKER  such  as 

sales  clerk,  real  estate  agent,  newsstand  operator, 

u;ta  entry  clerk,  secretary,  bank  teller    09 

SCIENCE  OR  ENGINEERING  PROFESSIONAL 

such  as  engineer  or      ientist   a  io 

SERVICE  WORKER  such  as  waiter,  hairdresser,  worker  in  fast 

food  establishment,    cook,  janitor,  beautimn,  childcare 

worker   v   \\ 

OTHER  (PLEASE  DESCRIBE)   12 


NOT  WORKING    13 

DON'T  KNOW  98 
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PART-4  YOUR  JOBS  AND  CHORES 

35.    Mot  counting  chores  around  the  house,  how  many  hours  do/did  you  work  a 
week  on  your  present  or  most  rr.cent  job? 

(CIRCLE  ONE) 


None,  never  worked  for  pay 

— > 

SKIP  TO  Question  38,  next  page 

Up  to  4  hours  a  week   

— > 

GO  TO  Question  36 

5-10  hours  a  week  

— > 

GO  TO  Question  36 

— > 

GO  TO  Question  36 

— > 

GO  TO  Question  36 

36.    Which  of  the  job  categories  below  comes  closest  to  the  kind  of  work  you 
do/did  for  pay  on  your  current  or  most  recent  job?  (Do  not  include  work 
around  the  house.    If  more  than  one  kind  of  work,  choose  the  one  that 
paid  you  the  most  per  hour,^ 

(CIRCLE  ONE) 

Have  not  worked  for  pay    00 

Lawn  work  or  odd  jobs    01 

Waiter  or  waitress   ,   02 

Newspaper  route    03 

Babysitting  or  child  care   04 

Farm  or  agricultural  work   05 

Other  manual  labor    06 

Store  clerk,  salesperson    07 

Office  or  clerical    08 

Other  (WRITE  IN  BELOW)    09 


49-50/ 


37.    Did  you  do  any  work  for  pay  last  week,  not  counting  work  around  the 
house? 

(CIRCLE  ONE) 

Yes  1  51/ 

No    2 

22 
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PART-3  YOUR  SCHOOL  LIFE 


During  the  first  semester  of  the  current  school  year,  has  *ny  of  che 
following  things  happened  to  you? 

(CIRCLE  OWE  Oil  EACH  LINE) 

More  than 
Never       Once  or  twice  twice 

a.  I  was  sent  to  the 
office  because  I 

was  misbehaving   0    1    2 

b.  I  was  sent  to  the 
office,  because  of 
problems  with  my 

school  work  0    1    2 

c.  I  was  kept  after  school 

for  misbehaving  0   1    2 

d.  Hy  parents  rece;  ed 
a  warning  about  my 

attendance   0    1   2 

e.  My  parents  received 
a  warning  about  my 

grades    0    1    2 

f.  Hy  parents  received 
a  warning  about  ray 

behavior   «  0    1    2 

g.  I  got  into  a  physical  fight 

with  another  student   0    1   2 
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39.    How  d<.  you  think  other  students  in  your  classes  see  you? 

(CIRCLE  OMB  Oil  EACH  LINE) 
Other  students  in  your  class  see  you  .  .  . 

Very  Somewhat  Not  at  all 


a.  As  popular?   

b.  As  athletic?   

c  As  socially  active?   

i.  As  a  good  student?   

e.  A*  important?  

f.  As  a  trouble-maker?   

g.  As  part  of  the  "in"  crowd?    1   2 


2 
2 
2 
2 
2 
2 


3 
3 
3 
3 
3 
3 
3 


59/ 

60/ 

61/ 

62/ 
63/ 

64/ 
65/ 


IN  THE  NEXT  SET  OP  QUESTIONS  WE  ARE  INTERESTED  IN  YOUR  THOUGHTS  ABOUT  YOUR 
SC'iOOL. 


40.  During  the  first  semester  oi  the  current  school  ye?r,  how  -nany  times 
have  any  of  tha  following  things  happened  to  you? 


Never 

a.  I  had  something 
stolen  from  me 

at  school   0  . 

b.  Someone  offered 
to  sell  me  drugs 

at  schoci.   0  . 

c.  Someone  threatened 
to  hurt  me  at 

school   0  . 


(CIRCLE  ONE  ON  EACH  LINE) 


Once  or  Twice 


More  than 
Twice 


..  2 


66/ 


67/ 


68/ 
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41.  Indicate  the  degree  to  which  each  of  the  following  matters  are  a  problem 
in  your  school. 


a. 

b. 
c. 
d. 

e. 

f. 

g* 

h. 


Student  tardiness  .... 

Student  ab. . nteeism  .. 

Student  cutting  class 

Physical  conflicts 
among  students   


Robbery  or  theft 


Vandalism  of  school 
property   


Student  use  of  alcohol 

.Student  use  of  illicit 
drugs   , 


Student  possession  of 
weapons   


Physical  abuse  of 
teachers   


(CIRCLE  OMR  ON  BACH  LIMB) 


Ser 


Verbal  abuse  of 
teachers   


ous 


Moderate 
....  2  ... 


Minor 
..  3  .. 
..  3  .. 
..  3  .. 


Not  a 
problem 


69/ 
70/ 
71/ 

72/ 
73/ 

74/ 
75/ 

4  76/ 

4  77/ 

BEGIN  DECK  15 
4  07/ 

4  08/ 


4 
4 
4 

4 
4 

4 
4 
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42.    How  much  do  you  agree  with  each  of  the  following  statements  about  your 
school  and  teachers? 


(CIRCLE  OMB  OH  EACH  LIMB) 


a.  Students  get  along 
well  with  teachers 

b.  There  is  real 
school  spirit   


Strongly 
agre 


c.  Rules  for  behavior 
are  strict   


d.  Discipline  is  fair 


e.  Other  students  often 
disrupt  clajs  


f.  Ihe  teaching 
is  good   


g.  Teachers  are 
interested  in 
students   


h.  When  I  work  hard  on 
school work,  my  teachers 
praise  my  effort   


i.  In  class  I  often  feel 
"put  down"  by  my 
teachers  , 


j.  Most  of  my  teachers 
really  listen  to 
what  I  have  to  say  . 

k.  I  don't  feel  safe 
a:  this  school   


1.  Disruptions  by  other 
students  get  in  the 
way  of  my  learning  . , 


m.  Misbehaving 

students  often  get 
away  with  it   , 


Agree  Disagree 


...  2 


.  3 


3 
3 


Strongly 
disagree 


4 
4 


09/ 

10/ 

11/ 
12/ 

13/ 
14/ 

15/ 

16/ 

17/ 

18/ 
19/ 

20/ 

21/ 
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PART-6  YOUR  SCHOOLWORK 

Son* time*  students  are  put  in  different  groups,  so  that  they  are  with  other 
students  of  similar  ability.    The  next  questions  are  about  ability  groups  in 
certain  school  subjects. 

43.    What  ability  group  are  you  in  for  the  following  classes? 

(CIRCL2  OMB  ON  BACH  LI HE) 

We  aren't 
High  Middle         Low  grouped 

a.  Mathematics    1    2  3   A  ... 

b.  Science   1   2  3   A  ... 

c.  English    1  ....«.,..  2   3   A  ... 

d.  Social  Studies  ...  1    2   3   A  ... 


I  don't 
know 


8  22/ 
8  23/ 


8 
8 


24/ 
25/ 
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44.  Which  of  che  following  classes  have  you  had  at  lease  once  a  week  during 
»       chis  school  year? 


a.  ENGLISH  (including  literature, 
composition,  language  arcs)  ... 


(CIRCLE  ALL  THAT  APPLY) 

26/ 


b.  SOCIAL  STUDIES  (including  government  or  civics, 
hiscory,  economicsf  geography,  currenc  events)  . 


c.  FOREIGN  LANGUAGE  

d.  PHYSICAL  EDUCATION  (gym)   , 

e.  REMEDIAL  MATH   , 

f.  RECUUR  MATH   , 

g.  ENRICHED  MATH    (advanced  roach,  honors  math)   >... 

h.  ALGEBRA   , 

i.  SCIENCE  (general  science)   , 

j.  BIOLOGY  (life  science)   ( 

k.  EARTH  SCIENCE   , 

1.  ART   ( 

m.  MUSIC   , 

n.  COMPUTER  EDUCATION   , 

o.  DRAMA  OR  SPEECH   , 

p.  RELIGIOUS  EDUCATION   

q.  HEALTH  EDUCATION   

r.  HOME  ECONOMICS  OR  FAMILY  LIVING   

s.  SHOP  (industrial  arts)   

t.  TYPING  OR  BUSINESS  EDUCATION   

u.  CAREER  GUIDANCE  (occupational  awareness  or  orientation) 

v.  AGRICULTURE   

w.  SEX  EDUCATION   

x.  A  SCIENCE  COURSE  IN  WHICH  YOU  HAVE  A  MORATORY   

y.  OTHER  (WRITE  IN 


27/ 

28/ 

29/ 

30/ 

31/ 

32/ 

33/ 

34/ 

35/ 

36/ 

37/ 
38/ 

39/ 

>  / 
41/ 

42/ 

43/ 

44/ 

45/ 

46/ 

47/ 

48/ 
49/ 
50/ 
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45.  Are  you  enrolled  in  any  courses  that  give  you  additional  help  in 
English  or  math? 

(CIRCLE  OMB  ON  EACH  LINE) 

Y«iS  No 

a.  Remedial  English  (language  arts)    1    2  51/ 

b.  Remedial  Mathematics    1    2  52/ 

46.  Are  you  enrolled  in  advanced  or  enriched  courses  in  any  of  the  following 
areas? 

(CIRCLE  ONE  ON  EACH  LINE) 
Yes  Mo 

a.  English  (language  arts)    1    2  53/ 

b.  Social  Studies    1    2  54/ 

c.  Science  1  ...^  2  55/ 

d.  Mathematics    1   2  56/ 

47.  Have  you  ever  taken  classes  on  drug  or  alcohol  abuse,  or  sex  education 
classes? 

(CIRCLE  ONE) 
Yes  No 

a.  Alcohol  or  drug  abuse  education   1   2  £7/ 

b.  Family  life  or  sex  education   1   2  58/ 


25 

4H2 


DECK  15 


48.    Are  you  enrolled  in  any  of  the  following  special  prog rams /services? 

(CIRCLE  OMB  OH  BACH  LIME) 

*.  Classes  for  gifted  or  N° 
talented  students   ±    2 

b.  Special  instruction  for  those 

whose  first  language  is  not  English— 
for  example,  bilingual  education  or 
English  as  a  second  language 

(not  regular  English  classes.)    I  .  2 


c.  Special  services  for  the 

orthopedically  handicapped  ,   i  2 

d.  Special  Education  services  for 

students  with  learning  problems    i    2 


the 


Questions  49-52 

For  each  of  the  eighth  grade  subjects  listed  below,  mark 
statement  that  best  expresses  your  opinion. 

49.  MATHEMATICS 

(CIRCLE  ONE  OM  EACH  LINE) 
Agree  Disagree         Don't  know 

a.  Mathematics  class 

is  usually  fun   1    2 


8 


b.  I  usually  look 
forward  to 
mathematics 

class    i 

c.  I  often  am 
afraid  to  a»* 
questions  in 

mathematics  class  ....  1 

d-  Math  will  be 
useful  in  my 
future    i 


60/ 
61/ 
62/ 


63/ 


64/ 


65/ 


66/ 
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50.  ENGLISH 

(CIRCLE  ONE  OB  EACH  LIME) 
Agree  Disagree         Don't  know 

a.  English  class 
is  usually  fun    I 

b.  I  usually  look 
forward  to 
English 

clasi    1    2    8  68/ 

c    I  often  am 
afraid  to  aak 
questions  in 

English  class    1  1   2    8  69/ 

d.  l  ^glish  will  be 
ufriful  in  my 

future    1    2    8  70/ 


51.    SOCIAL  STUDIES 

(CIRCLE  ONE  ON  EACH  LINE) 
Agree  Disagree         Don't  know 

a.  Social  studies  class 

is  usually  fun    1    2    8  71/ 

b.  I  usually  look 
forward  to 
social  studies 

class    1    2    8  72/ 

c.  I  often  am 
afraid  ~o  ask 
questions  in 

social  sturies  class  -  1    2    8  73/ 

d.  Social  studies  will  be 
useful  in  my 

future    1  ......    2    8  74/ 


67/ 
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52.  SCIENCE 

(CIRCLE  ONE  ON  EACH  LIME) 
Agree  Disagree         Don't  know 

a.  Science  class 

is  usually  fun   1    2    8  75/ 


b.  I  usually  look 
forward  to 

science  class    1 

c.  I  often  an 
afraid  to  ask 
questions  in 

science  class    1 

d.  Science  will  be 
useful  in  my 

future   „   l 


53.  Do  you  ever  feel  bored  when  you  are  at  school? 

(CIRCLE  ONE) 

Never    1 

Once  in  a  while  2 

About  half  of  the  time  3 
Most  of  the  time  4 


76/ 


77/ 


78/ 


BEGIN  DECK  16 

07/ 
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54*  Were  you  ever  held  back  (made  to  repeat)  a  grade  in  school? 


No    1  — >  CO  TO  Question  55 

Yes    z  — >  I  repeated  grade(s): 

(CIRCLE  ALL  THAT  APPLY) 
GRADES  REPEATED 


a.  Kindergarten    1 

b.  Grade  1    1 

c.  Grade  2    1 

d.  Grade  3    1 

e.  Grade  4    1 

f.  Grade  5    1 

g.  Grade  6    1 

h.  Grade  7    1 

i.  Grade  8....«   1 

55.  How  many  different  schools  have  you  attended  since  starting  first  grad 

(CIRCLE  ONE) 


1  school    1 

2    2 

3    3 

4    4 


5  or  more  schools  ••••  5 
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36.  Did  you  go  to  any  of  these.' 

(CIRCLE  OMB  ON  EACH  LIME) 

Y3S  No         I  don't  know 

&•  Kindergarten    1   2  ........  8 

b.  Day  care    1   2   8 

c.  Nursery  school  or  preschool    l   2   8 

d.  Head  Start    1  .....  2   8 

e .  Extended  Day    1  .....  2  ........  8 


Sometimes,  b«:  l?ss 

than  orce  a  week    2 

Not  every  day,  but 

at  least  once  a  week    3 

Daily   ....  4 


19/ 
20/ 
21/ 
22/ 
23/ 


57.  How  xany  days  of  school  did  you  miss  over  th    past  four  weeks? 

(CIRC  -  oME) 

None   i  24/ 

1  or  2  day  a  2 

3  or  4  days   3 

5  to  10  days    4 

hore  then  10  days    5 

58.  How  often  do  you  cut  or  skip  classes? 

(CIRCLE  ONE) 
Never  or  almost  never   1 


25/ 
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59*  How  many  times  were  you  late  for  school  over  the  past  four  weeks? 

(CIRCLE  ONE) 

None    0  *6/ 

1  or  2  days    1 

3  or  4  days   ,  2 

5  to  10  days   3 

More  than  10  days  . . . .  4 

60.  How  often  do  you  come  to  class  and  find  yourself  WITHOUT  these  chings? 

(CIRCLE  ONE  OH  EACH  LINE) 
Usually    Often      Seldom  Never 

a.  Pencil  or  paper  (if  needed)    1   2    3   4 

b.  Books  (if  nteied)    1  2    *    4  28^ 

c.  Your  homework  done  (if  assigned)  .  1   2   3   4 

61.  In  the  following  subjects,  about  how  much  time  do  you  spend  on  homework 

EACH  WEEK? 


(Cr.CLE  ONE  ON  EACH  LINE) 


'ess 
than 


HOURS  PER  WEEK: 

None 

1 

hour 

1 

hour 

2 

hours 

3 

hours 

4-6  7-9 
hours  hours 

10 
or  more 

a    Mathematics  homework  .. 

.  00  . 

.  01  . 

.  0*  . 

..  03  . 

..  04  . 

•  • 

05 

06  . 

..  07 

30-31/ 

.  00  . 

.  01  . 

.  02  . 

..  03  . 

..  04  . 

•  • 

05  .... 

06  . 

..  07 

32-33, 

.  00  . 

.  01  . 

.  02  . 

..  03  . 

..  04  . 

•  • 

05   

06  . 

..  07 

54-35 

d.  Social  Studies  homework 

00  . 

.  01  . 

.  02  . 

..  03  . 

..  04  . 

•  • 

05  .... 

06  . 

..  07 

36-37 

e.  Homework  for  all  other 

.  00  . 

.  01  . 

.  02  . 

..  03  . 

..  04  . 

•  • 

05  .... 

06  . 

..  07 

38-39 
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62,  How  much  additional  reading  do  you  d-  each  week  on  your  own  outsm* 


school— not  in  connection  with  schoolwork? 

(CIECLB  OMB) 


6  hours  or  more  per  week  ....  5 

•  Mark  the  statement  that  best  describes  your  grades  in  school  from  sixth 
grade  up  till  now: 

(CIRCLE  OHE) 

Mostly  As  (or  a  numerical  average  of  .  3  -  iOO)    01 

About  half  As  and  half  Bs  (or  8b  -  89)    02 

Mostly  Bs  (or  80  -  84)   03 

About  half  Bs  and  half  Cs  (or  75  -  79)    04 

Mostly  Cs  (or  70  -  74)  e  ,   05 

About  half  Cs  and  half  Ds  (or  65  -  69)    06 

Mostly  Ds  (or  60  -  64)   07 

Mostly  below  D  ,  ,   08 

Does  noc  apply  to  me— my  classes  are  not  graded    09 
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64.  For  each  of  the  school  subjects  listed  below,  mark  whe  statement  that 
best  describes  your  grades  from  sixth  g  ide  up  till  now. 

(CIRCLE  OMB) 

a.  ENGLISH 

Hostly  As  (a  numerical  average  of  90  -  100)    1 

Mostly  Bs  (80  -  89)    2 

Hostly  Cs  (70  -  79)    3 

Mostly  Ds  (60  -  69)  4 

Mostly  below  D  (below  60)    5 

Does  not  apply  to  me— ay  classes  are  not  graded   6 

b.  MATHEMATICS  (CIRCIJj  Qm) 

Mostly  Aa  (a  numerical  average  of  90  -  100)    1 

Mostly  Bs  (80  -  89)   „   2 

Hostly  Cs  (70  -  79)   ,   3 

Hostly  Ds  (60  -  69)   4 

Hostly  below  D  (below  60)    5 

Does  not  apply  to  me—my  classes  are  not  graded   6 
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c.  SCIENCE  (CIRCLE  ONE) 

Mostly  As  (a  numerical  average  of  90  -  100)    1 

Mostly  Bs  (80  -  89)   2 

Mostly  Cs  (70  -  79)    3 

Mostly  Ds  (60  -  69)    4 

Mostly  below  D  (below  60)    5 

Does  not  apply  to  me — my  classes  are  not  graded    6 

d.  SOCIAL  STUDIES  ( CIRCLE  ONE) 

Mostly  As  (a  numerical  average  of  90  -  100)    1  46/ 

Mostly  Bs  (80  -  89)    2 

Mostly  Cs  (70  -  79)    3 

Mostly  Ds  (60  -  69)   4 

Mostly  below  D  (below  60).   5 

Does  not  apply  to  me— my  classes  are  not  graded    6 
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PART-7  YOUR  ACTIVITIES 


65.    Have  you  taken  part  or  will  you  hav>  participated  in  any  of  the 

following  type*  of  school  activities  during  the  current  school  year, 
either  as  a  member,  or  as  an  officer  (for  example,  vice-president , 
coordinator,  team  captain)? 

(CIRCLE  ALL  m>  1AT  APPLY) 


Yes, 

member  or 
participant 

a.  Science  fairs    1  47/ 

b.  School  varsity  sports  (playing  against 

teams  from  other  schools)    \  49/ 

c.  Intramural  sports  (playing  against  teams 

from  your  own  school)    1  51/ 

d.  Cheerleading  4   1 

e*  Band    1  55/  • 

f.  Orchestra   1 

g.  Che  ru*  or  choir    \ 

h.  Dance  c   1   , ,  , 

  01/  • 

i.  History  club  w  ...  1 

 *  63/  • 

j.  Science  club    1  65/ 

k.  Math  club    \  67/  . 

1.  Foreign  Language  club    1  69/  . 


m.  Other  subject  matter  club 
(WRITE  III 


)  ....  1  71/ 


n.  Debate  or  speech  team    1  73/ 

o.  Drama  club    1  75/ 

BEGIN  DECK  17 

p.  Academic  Honors  Society    1  Q7/ 

q.  St    ent  newspaper    1  gg/ 

Cont.  next  page 


*es, 
officer  or 
leader 
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(CIRCLE  ALL  THAT  APPLY) 


Yes, 

member  or 

participant 

r.  Student  yearbook   1  11/  , 

s.  Service  club   1  13/  , 

t.  Studen'  council   1  15/  . 

u.  Computer  club    1  17/  . 

v.  Religious  organization    1  19/  . 

w.  Vocational  educaticn  club   1  21/  . 


x.  Other  school  club 
(WRITE  III 


Yes, 
officer  or 
leader 


 )  ....  1  23/ 


12/ 
14/ 
16/ 
18/ 
20/ 
22/ 

24/ 


AO 
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66.    Have  you  taken  part  or  will  you  have  j-arti-ipated  in  any  of  the 

following  types  of  outside-school  activities  this  year,  either  as  a 
member,  or  as  an  officer  (for  example,  vice-president,  coordinator, 
team  captain)? 

(CIRCLE  ALL  THAT  APPLY) 


Yes, 

member  or 
part. cipant 


Yes, 
officer  cr 
leader 


h.  Scouting   *   1  23/  

b.  Church  youth  groups    1  27/  

c.  Hobby  club  ,   i  29/  • 


1  26/ 
1  28/ 
I  30/ 


d.  Neighborhood  clubs 
or  programs   


e.  Boys'  clubs  or 

girls'  clubs    1  33/ 


1  31/   1  32/ 

  1  34/ 


f.  Non-school  team 

sports    1  35/ 

«•  *-»    i  37/ 

h.  Y  or  other  youth 

groups   ,..  1  39/ 

' .  Summer  programs , 

such  as  summer  workshops 
0.  institutes  in  science, 
language,  drama,  debate, 

and  so  on    1  41/ 

j.  Other  (WHITE  IM)  ..  1  ^ 


36/ 
38/ 


1  40/ 


42/ 
44/ 


41 
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Tenth  Grade  Questionnaire 
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TENTH  GRADE  QUESTIONNAIRE 

NELS.-88 
NATIONAL  EDUCATION 
LONGITUDINAL 
STUDY  OF 
1988 
FIELD  TEST 


Prepared  for:  U.S.  Department  qT  Education 

Center  for  Education  Statlatlc* 

By:  ifORC,  k  Social  Seloaoe  Beeearct  Center 
University  or  Chlc-^a 


As  a  matter  of  policy,  the  Center  for  statistics  is  concerned  *xth  protecting  the  privacy  of  individuals 
participatt  in  volurtary  survtys.    ue  **nt  to  let  you  know  that: 

1.  Section  406  of  the  General  Education  Provisions  Act  <2*HJSC  122le-t)  cllows  us  to  ask  you  the  questions  in 
this  questionnaire. 

2.  You  may  skip  any  questions  you  do  not  wish  to  antv?r. 

3.  We  are  asking  you  these  questions  in  order  to  gather  information  about  what  happens  to  students  as  they 
move  out  of  high  school  and  make  decisions  about  post secondary  education  and  work. 

4      your  responses  Mill  be  «erged  «ith  those  of  other  students,  and  tne  answers  you  give  will  never  be 
identified  as  yours. 


GENERAL  INSTRUCTIONS 


PLEASE  READ  EACH  QUESTION  CAREFULLY 

It  is  important  that  you  follow  the  directions  for  responding  to  each 
kind  of  question.    These  are: 

(CIRCLE  ONE) 

What  is  the  —lor  of  your  eyes? 

(CIRCLE  ONE) 

Br0wn    1  If  the  color  of  your 

 2  eyes  is  green ,  you 

Green  <Q  would  circle  the  three 

Another  Color    4  *s  shown. 

(CIRCLE  ALL  THAT  APPLY) 

Last   /eek,  did  you  do  any  of  the  following? 

(CIRCLE  ALL  THAT  APPLY) 

a.  See  a  play    1  ir  y0u  ^nt  rr  a  m^ 

b.  Go  to  a  movie  Q  and  attend* i  a  sport- 
ed. Attend  a  sporting  event  ....£)  ing  event  laat  week, 

you  would  circle  two 
items  as  shown. 

(CIRCLE  ONE  ON  EACH  LINE) 

Do  you  plan  to  do  any  of  the  following  next  week? 

(CIRCLE  ONE  ONE  EACH  LINE) 

If  you  plan  to  study 
Yes  Not  Sure  Kc    at  a  friend's  house, 

a.  Visit  a  relative   1  ...  2   73)  do  not  plan  to  visit  a 

b.  Co  to  a  museum   1  ...<2>t...  3    relative,  and  are  not 

c.  Study  at  a  sure  about  going  to  a 

friend's  house  2  ••••  3    museum  next  wesk,  you 

would  circle  one  on 
each  line  as  shown. 


This  questionnaire  is  not  a  test.    We  hope  you  will  answer  every 
question,  but  you  may  skip  any  question  you  do  not  wish  to  answer. 
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WE  HOPE  YOU  WILL  ANSWER  EVERY  QUESTION,  BUT  YOU  MAY  SKIP  ANY  QUESTION 
YOU  DO  NOT  WISH  TO  ANSWER. 

1*    Which  of  the  following  best  describes  your  present  high  school 


program: 

(Circle  One) 

General    CI 

Academic  or  college  preparatory   ,  02 

Vocational  (Occupational  preparation) 

Agricultural  occupations    03 

Business  or  office  occupations  04 

Distributive  education   .   05 

Health  occupations   „  06 

Home  economics  occupations    07 

Technical  occupations    08 

Trade  or  industrial  occupations   ,  09 

2.  Were    ou  assigned  to  the  program  you  art  now  in,  or  did  you  choose 

it  yourself? 

(Circle  One) 

I  was  assigned   1 

I  chose  it  myself    1 

3.  Do  you  expect  to  graduate  from  high  school? 

(Circle  One) 

Ye   1 

Probably  *  «,?   2 

Probably  not   s   3 

No    4 
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4.    When  do  you  expect  to  leave  high  school? 

(Circle  One) 

Before  the  beginning  of  the  next  school  year 

(Before  September  1987)    1 

During  the  next  school  year  (September  1987 

to  June  1988)    2 

After  June  1988  but  before  graduation   3 

After  I  graduate  »  ,  4 
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Do  you  have  a  definite  job  lined  up  after  you  leave  high  school? 

(Circle  One) 

Yes    i 

No   B  2 

During  the  tenth  grade,  incluaing  all  of  this  school  year,  hov  much 
course  work  will  you  have  taken  in  each  of  the  following  subjects? 
Count  only  courses  that  meet  at  least  three  times  (or  three 
periods)  a  week. 

(Circle  One  On  Bach  Line) 


1/2         1       More  than 
None    year     year       1  year 

a.  Mathematics    1  ...  2  ...  3  4 

b.  English  or  Literature  ..  1  ...  2  ...  3  4 

c.  French    1  ...  2  ...  3  4 

d.  German    l  ...  2  ...  3  4 

e.  Spanish    1  .,  .  2  ...  3  4 

f .  History  or  social 

studies    l  ...  2  ...  3  4 

g.  Science   1  ...  2  ...  3   4 

h.  Business,  office,  or 

studies   ,  1  ...  2  ...  3  4 

i.  Trade  and  industry  1  ...  2  ...  ?  4 

j.    Technical  courses  1  ...  2  ...  3  4 

k.    Other  vocational  courses  1         2  ...  3  4 
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Which  of  the  following  best  describes  your  grades  so  far  in  high 
school? 

(Circle  One) 

Mostly  A's  (or  a  numerical  average  of  90-100)   01 

About  half  A's  and  half  B's  (or  85-89)    02 

Mostly  B's  (or  80-84)   «.  03 

About  half  B's  and  half  C's  (or  75-79)    04 

Mostly  C's  (or  70-74)    05 

About  half  C's  ana  half  D's  (or  65-69)    06 

Mostly  D's  (or  60-64)   07 

Mostly  below  D  (or  below  60>   08 


5 
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Circle  all  the  statements  that  apply  for  each  of  the  subjects 
listed  below. 


A.  Mathematics 

a.  I  got  mostly  A's  and  Bfs  in  this  subject  ... 

b.  It  will  be  useful  in  my  future   

c.  It  was  interesting  to  me   

d.  Took  no  mathematics  courses   

B.  English  or  literature 

a.  I  got  mostly  A's  and  B's  in  this  subject  ... 

b.  It  will  be  useful  in  my  future   

c.  It  was  interesting  to  me   

d.  Took  no  English  or  literature  courses   

C.  Business,  office,  or  sales 

a.  I  go    mostly  A's  and  B's  in  this  subject  ... 

b.  It  will  be  useful  in  my  future   

c.  It  was  interesting  to  me   ,« 

d.  Took  no  business  courses   

D.  Trade  or  industry 

a.  I  got  mostly  A's  and  B's  in  this  subject  ... 

b.  It  will  be  useful  in  my  futu~~»   

c.  It  was  interesting  to  me   

d.  Took  no  trade  or  industrial  courses  


(Circle  All  That  Apply) 
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Are  you  now  taking  or  do  you  plan  to  take  high  school  courses 
any  of  the  following  areas? 

(Circle  One  On  Each  Line) 
Not 

Yes  No  Certain 

a«      Agriculture,  including 

horticulture    1  2  3 

b.  Auto  mechanics    1    2    3 

c.  Commercial  arts    1  .......  2  ......  3 

d.  Computer  programming 

or  computer  operations         I  2  ,  3 

e.  Construction  trades: 

1.  Carpentry,  cabinet 

making,  or  millwork  ...  1  2  3 

2.  Electrical    1    2   3 

3.  Masonry  . . ,   1  2  3 

4.  Plumbing    1    2  3 

f.  Cosmetology,  hairdressing, 

or  barbering    1    2   3 

g.  Drafting    1  2  3 

h.  Electronics    1  2  .......  3 

i.  Home  economics,  including 

dietetics  and  child  care  •  1  2    3 

j.  Machine  shop  ,   1   2    3 

k.  Medical  or  dental  assisting  1   2    3 

1«  Practical  nursing    1   2    3 

m.  Quantity  food  occupations  ••  1   2    3 

n.  Sales  or  merchandising   1   2    3 

o.      Secretarial,  stenographic, 
typing,  or  other  office 

work    1  2    3 

p.      Welding    1   2    3 
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9.    Have  you  ever  been  in  any  of  the  following  programs? 

(Circle  One  On  Each  Line) 
Yes  No 


a.  Remedial  English 

(sometimes  called  basic  or  essential)    1  ....  2 

b.  Remedial  Mathematics 

(sometimes  called  basic  or  essential)    1  ....  2 

c.  Advanced  or  honors  program  in  English  , ...  1  ....  2 

d>      Advanced  or  honors  program  in  Mathematics    1  ....  2 

e.  Bilingual  or  bicultural  program    l  ....  2 

f.  Family  life  or  sex  education   1  ....  2 

g.  Alcohol  or  drug  abuse  education    1  ....  2 

h.  Special  program  for  the 

educationally  handicapped    1  ....  2 

i.  Special  program  for  the 

physically  handicapped    1  ....  2 


ERJC 
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10*    Have  you  ever  heard  of  or  participated  in  any  of  the  following 
high  school  educational  programs? 


(Circle  One  On  Bach  Line) 

Have 
heard 

Never  of  this  Have 

heard  program  participated 

of  this  but  have  not  in  this 
program         participated  program 


a.  Cooperative  Vocational 

Education  Program 

(Co-op  Program)    1   2    3 

b.  High  School  Vocational 

Education  Work-Study 

Program   1   2    3 

c.  Talent  Search   1    2    3 

d.  Upward  Bound    1    2   3 

e.  Continuation  High  School    1    2    3 

f.  Alternative  High  School   1   2   3 

g»  Special  School  for 

pregnant  girls  or  mothers  •  1    2   3 

h.  JTPA  (Job  Training 

Partnership  Act)    1   2    3 

i.  Junior  ROTC    1   2   3 
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Approximately  wUat  is  the  average  amount  of  time  you  spend  on 
homework  a  we^k? 

(Circle  One) 


No  homework  is  ever  assigned    01 

I  have  homework,  but  I  don't  do  it    02 

Less  than  1  hour  a  week    03 

Between  1  and  3  hours  a  week  04 

More  than  3  hours,  less  than  5  hours  a  week  05 

Between  5  and  10  hours  a  week    06 

More  than  10  hours  a  week  *•   07 


Between  the  beginning  of  school  last  fall  and  Christmas  vacation, 
about  how  many  days  were  you  absent  from  school  for  any  reason, 
not  counting  illness? 

(Circle  One) 


None    01 

I  or  2  days    02 

3  or  4  days    03 

5  to  10  days    04 

II  to  15  days    05 

16  to  20  days  ••••   06 

21  or  more    07 
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13.    Between  the  beginning  of  school  last  fall  and  Christmas  vacation, 
about  how  many  days  were  you  late  co  school? 

(Circle  One) 

None   *   01 

I  or  2  days    02 

3  or  A  days   *   03 

5  to  10  days   OA 

II  to  15  days    05 

16  to  20  days    06 

21  or  more   07 


11 
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Have  you  participated  in  any  of  the  following  types  of  activities 
either  in  or  out  of  school  this  year? 

(Circle  One  On  Bach  Line) 

Have  Have 
not  participated 
participated  actively 

a.  Athletic  teams  -  in  or 

out  of  school    1    2 

b.  Cheer  leaders,  pep  club, 

majorettes   ,   l    2 

c.  Debating  or  drama    1    2 

d.  Band  or  orchestra    1    2 

e.  Chorus  or  dance    1    2 

f.  Hobby  clubs  such  as 

photography,  model 
building  hot  rod, 

electronics,  crafts    1    2 

g*  School  subject-matter 

clubs,  such  as  science, 
history,  language, 

business,  art    1    2 

h.  Vocational  education  clubs, 

S'ich  as  Future 
Homemakers,  Teachers, 
Farmers  of  America, 

DECA,  FBLA,  or  VICA   1    2 

i.  Youth  organizations  in 

the  community,  such 

as  Scouts,  Y,  etc  1    2 

j.  Church  activities, 
including  youth 

groups    1    2 

k.  Junior  Achievement    1    2 

1.  Co-op  club    1    2 


488 


IS.    Please  mark  whether  each  of  the  following  s  atements  is  true  or 
false  for  you. 

(Circle  One  On  Each  Line) 


True  False 

a.  I  an  usually  at  ease  in  English  class   1  2 

b.  Doing  English  assignments  makes  me  feel  tense  ...  1   2 

c.  English  class  does  not  scare  me  at  all    1   2 

d.  I  dread  English  class    1  2 

e.  I  am  usually  at  ease  in  Mathematics  class   1  2 

f.  Doing  Mathematics  assignments  makes  me  feel  tense  1  2 

g.  Mathematics  class  does  not  scare  me  at  all    1  2 

h.  I  dread  Mathematics  class    1  2 


16.    Which  of  the  following  people  live  in  the  same  household  with  you? 

(Circle  All  That  Apply) 

a.  I  live  alone    1 

b.  Father    1 

c.  Other  male  guardian 

(stepfather  or  foster  father)    1 

d.  Mother    1 

e.  Other  female  guardian 

(stepmother  or  f outer  mother)    1 

f.  Brother(s)  and/or  sister(s) 

(including  step*  or  half-)    1 

g.  Grandparent(s)    1 

h.  My  husband/wife  *   1 

i.  My  child  or  my  children   1 

j.  Other  relative(s)  (children  or  adults)    i 

k.  Non-relative(s )  (children  or  adults)    1 

13 
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17.    Please  describe  below  the  job  most  recently  held  by  your  father 
(stepfather  or  male  guardian),  even  if  he  is  not  working  at 
present. 


(WRITE  IN)  

Which  of  the  categories  below  comes  closest  to  describing  that  job? 

(Circle  One) 

Do  not  live  with  father  (stepfather  or  male  guardian)   01 

CLERICAL  such  as  bank  teller,  bookkeeper,  secretary, 

typist,  mail  carrier,  ticket  agent   ,   02 

CRAFTSMAN  such  as  baker,  automobile  memanic,  machinist, 

painter,  plumber,  telephone  installer,  carpenter    03 

FARMER,  FARM  MANAGER    OA 

HOMEMAKER  OR  HOUSEWIFE  ONLY    05 

LABORER  such  as  construction  worker,  car  washer,  sanitary 

worker,  farm  laborer    06 

MANAGER,  ADMINISTRATOR  such  as  sales  manager,  office 

manager,  school  administrator,  buyer,  restaurant  manager, 
government  official    07 

MILITARY  such  as  career  officer,  enlisted  man  or  woman  in 

the  Armed  Forces    08 

Continued,  next  page 
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OPERATIVE  such  as  meat  cutter,  assembler,  machine  operator, 

welder,  taxi cab*  bus,  or  truck  driver  09 

PROFESSIONAL  such  as  accountant,  artist,  registered  nurse, 
engineer,  librarian,  writer,  social  worker,  actor,  actress, 
athlete,  politician,  but  not  including  school  teacher    10 

PROFESSIONAL  such  as  clergyman,  dentist,  physician,  lawyer, 

scientist,  college  teacher    11 

PROPRIETOR  OR  OWNER  such  as  owner  of  a  small  business, 

contractor,  restaurant  owner    12 

PROTECTIVE  SERVICE  such  as  detective,  police  officer  or  guard, 
sheriff,  fire  fighter  4   13 

SALES  such  as  salesperson,  advertising  or  insurance  agent, 

real  estate  broker    14 

SCHOOL  TEACHER  such  as  elementary  or  secondary    15 

SERVICE  such  as  barber,  beautician,  practical  nurse,  private 

household  worker,  janitor,  waiter    16 

TECHNICAL  such  as  draftsman,  medical  or  dental  technician, 

computer  programmer    17 

Never  worked  ♦   18 

Don't  know  ...r.,   19 
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ease  describe  below  the  job  roost  recently  held  by  your  mother 


present • 

(WRITE  IN)  

Which  of  the  categories  below  comes  closest  to  describing  that  job? 

(Circle  One) 

Do  not  live  with  mother  (stepmother  or  female  guardian)   01 

CLERICAL  such  as  bank  teller,  bookkeeper,  secretary, 

typist,  mail  carrier,  ticket  agent    02 

CRAFTSMAN  such  aj  baker,  automobile  mechanic,  machinist, 

painter,  plumber,  telephone  installer,  carpenter    03 

FARMER,  FARM  MANAGER    04 

HOMEMAKER  OR  HOUSEWIFE  ONLY  05 

LABORER  such  as  construction  worker,  car  washer,  sanitary 

worker,  farm  laborer    06 

MANAGEP ,  ADMINISTRATOR  such  as  sales  manager,  office 

manager,  school  administrator,  buyer,  restaurant  manager, 
government  official   ,  07 

MILITARY  such  as  career  officer,  enlisted  man  or  woman  in 

the  Armed  Forces    08 

Continued,  next  page 
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OPERATIVE  such  at  meat  cutter,  assembler,  machine  opcr*"r , 

welder,  tazicab,  bus,  or  truck  driver    09 

PROFESSIONAL  such  as  accountant,  artist,  registered  nurse, 
engineer,  librarian,  writer,  social  worker,  actor,  actress, 
athlete,  politician,  but  not  including  school  teacher    10 

PROVISIONAL  such  as  clergyman,  dentist,  physician,  lawyer, 

scientist,  college  teacher    11 

PROPRIETOR  OR  OWNER  such  as  owner  of  a  small  business, 

contractor,  restaurant  owner    12 

PROTECTIVE  SERVICE  such  as  detective,  police  officer  or  guard, 
sheriff,  fire  fighter  ,   13 

?\LES  such  as  salesperson,  advertising  or  insurance  agent, 
real  estate  broker    14 

SCHOOL  TEACHER  such  as  elementary  or  secondary    15 

SERVICE  such  as  barber,    eautician,  practical  nurse,  privat? 
household  worker,  janitor,  waiter    16 

TECHNICAL  such  as  draftsman,  medical  or  ae*    *1  -ichnician, 

computer  programmer    17 

Never  worked    18 

Don't  know    19 
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19*    What  was  the  highest  level  of  education  your  father  (stepfather  or 
male  guardian)  completed? 

(Circle  One) 


Do  not  live  with  father  (stepfather  or  male  guardian)    01 

Less  than  high  school  graduation   ,   02 

High  school  graduation  only  ,   03 


Vocational,  trade,  {Le^s  than  two  years    04 

or  business  school   , { 

after  high  school  {Two  years  or  more   05 


{Less  whan  Zvo  years  of  college  06 

r 
I 

{Two  or  more  years  of  college 

(including  two  year  degree)  . ...  07 

{ 

College  program  {Pinished  college 

(four-  or  five-year  degree)  . ...  08 

f 

toaster's  degree  or  equivalent  ....  09 

{ 

{Ph.D,  M.D.,  or 

other  advanced  degree  •   10 


Don't  know    11 

20*    How  much  of  his  life  has  your  father  (stepfather  or  male  guardian) 
spent  in  the  United  States? 

(Circle  One) 

All  or  almost  all   01 

More  than  20  years,  but  not  all   02 

About  11-20  years    03 

About  6-10  years    04 

About  1-5  years    05 

Don't  know    06 
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21.    What  was  the  highest  level  of  education  your  mother  (stepmother  o 
female  guardian)  completed? 

(Circle  One) 

Do  not  live  with  mother  (stepmother  or  female  guardian)    01 

Less  than  high  school  graduation    02 

High  school  graduation  only    03 


Vocational,  trade,  {Less  than  two  years    04 

or  business  school   { 

after  high  school  {Two  years  or  more    05 


{Less  than  two  years  of  college  06 

{ 

{Two  or  more  years  of  college 

(including  two  year  degree)   07 

{ 

College  program  {Finished  college 

(four-  or  five-year  degree)    08 

( 

{Master's  degree  or  equivalent    09 

{ 

{Ph.D,  M,D. ,  or  other  advanced  degree  10 


Don't  know   11 


22.    How  much  of  her  life  has  your  mother  (stepmother  or  female 
guardian)  spent  in  the  United  States? 

(Circle  One) 


All  or  almost  all    01 

More  than  20  years,  but  not  all   02 

About  11-20  years    03 

About  6-10  years    04 

About  1-5  yearr    05 

Don't  know   06 
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23.  Were  you  born  in  the  United  States? 

(Circle  One) 

Ye   1 

No    2 

24.  How  much  of  your  life  have  you  spent  in  the  United  States? 

(Circle  One) 

All  or  almosc  all    1 

More  than  10  years,  but  not  all   2 

About  6-10  years  3 

AUjw't  1-5  years   „,  4 


75.    Are  the  following  statements  about  your  parents  true  or  false? 

(Circle  One  On  Bach  Line) 

Does 
Not 

True  False  Apply 

a.  My  mother  (stepmother  or 

remale  guardian)  keeps 
close  track  of  how  well 

I  am  doing  in  school    1  2    3 

b.  My  father  (stepfather  or 

male  guardian)  keeps 
close  track  of  how  well 

I  am  doing  in  school    1   2    3 

c.  My  parents  (or  guardians) 

almost  always  know  where 

I  am  and  what  I'm  doing   1   2    3 
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26.  During  week  days  about  how  many  hours  per  day  do  you  watch  TV? 

(Circle  One) 

Don't  watch  IV  during  week   01 

Less  than  1  hour   02 

1  hour  or  mora,  less  than  2  ...  03 

2  hours  or  more,  less  than  3   04 

3  hours  or  more,  less  than  4   OS 

4  hours  or  more,  less  than  5   06 

5  or  more   »  07 

27.  **ow  much  have  you  talked  to  the  following  people  about  planning 

your  school  program? 

(Circle  One  On  Bach  Line) 

Not  A 

At  Great 
All  Sometimes  Deal 

a.  Your  father    1    2    3 

b.  Your  mother    1    2    3 

c.  A  guidance  counselor   1    2  •*   3 

d.  Teachers   1    2    3 

e.  Friends  or  relatives    1    2    3 
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What  do  each  of  the  following  people  think  you  ought  to  do  after 
high  school? 

(Circle  One  On  Bach  Line) 


Enter  a 
trade 
Get  a  school 
Go       full-     or  an 
to       time  appren- 


Enter  They  I  Does 
military    Don't    don't  Not 


college    job       ticeship     servi ce     care     know  Apply 


Your  father 

Your  mother 

A  guidance 
counselor 


Teachers 


01 
01 

01 
01 


Friends  or 
relatives 
about  your 
own  age  01  . 


02   03 

02   03 

02   03 

02   03 

02   03 


04 
04 

04 
04 

04 


05 
05 

05 
05 

05 


06  . 
06  . 

06  . 
06  . 


.  07 
.  07 

.  07 
.  07 


06  ..  07 
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19.    How  do  you  and  your  friends  in  this  school  mostly  feel  about  these 
different  kinds  of  students? 

(Circle  One  On  Each  Line) 


Mostly  think        Mostly  do  not 

well  of  such         think  well  of        Makes  no 

a  student  such  a  student  difference 

A.  Students  who  get 

very  good  grades: 

Dp  you   1    2    3 

Do  your  friends    1    2   3 

B.  Students  who  are 

very  good  athletes: 

Do  you  €   l    2   3 

Do  your  friends    1    2    3 

C.  Students  who  are 

very  active  socially: 

Do  you   1    2   3 

Do  your  friends    1   2   3 
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How  do  other  sophomores  in  your  school  see  you? 

(Circle  One  On  Each  Line) 


Very 


Somewhat 


Not  at  all 


a.  As  popular   

b.  As  athletic   

c.  As  socially  active 

d.  As  a  good  student  . 

e.  As  important   

f.  As  a  trouble-maker 

g.  As  part  of  the 

leading  crowd 


2 
2 
2 
2 
2 
2 


3 
3 
3 
3 
3 
3 


Have  you  ever  had  the  following  experience? 

(Circle  One  On  Each  Line) 


Yes 

No 

a. 

b. 

Traveled  outside  of  this  state?   

c. 

d. 

e. 

Taken  an  ability  test  outside  of  school? 

f. 

g* 

h. 
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32.    How  do  you  ftel  about  each  of  the  following  statements? 

(Circle  One  On  Bach  Line) 

Agree  Disagree  No 

strongly     Agree     Disagree     strongly  opinion 

a.  I  take  a  positive 
attitude  toward 

myself    1  2  3   4  5 


b.  Good  luck  is  more 
important  than  hard 

work  for  success  ••••  1  2 

c.  I  feel  I  am  a  person 
of  worthy  on  an  equal 

plane  with  others  ...  1  2 

d.  I  am  able  to  do  things 
as  well  as  most  other 

people   .1  2 


e.  Every  time  I  try  to 
get  ahead ,  something 
or  somebody  stops  me    1  2 

f •  Planning  only  makes  a 
person  unhappy ,  since 
plans  hardly  ever 
work  out  anyway   1  2 


g.  People  who  accept  their 
condition  in  life  are 
happier  than  those  who 

try  to  change  things    1  2    3 

h.  On  the  whole,  I  am 

satisfied  with  myself  1  2    3 

i.  What  happens  to  me 

is  my  own  doing  ••••  1  2    3 

j.  At  times  I  think  I 

am  no  good  at  all       1  2    3 


k.  When  I  make  plans, 
I  am  almost  certain 

I  can  make  them  work  1  2    3   4   5 

1.  I  feel  I  do  not  have 

much  to  be  proud  of    1  2   3    4  5 
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*"     or  false?  (Circle  One  On  Each  Line) 


_ •    i  ,.h-  wav  my  education  is  going 

a.  I  am  •atiffied  with  the  way  ny 


True 
..  1  . 


b.  I  have  had  di.ciplin.ry  RJjtt-Jt  year 
in  school  curing  the  last  year 


galse 
..  2 


1 
1 
1 


c    i  am  interested  in  school   

d.  x  have  been  suspended  or  put  on  probation  in  school  , 

e.  Every  once  in  a  while  I  cut  a  clas   

£.  I  don't  feel  safe  at  this  school   


2 
2 
2 
2 

,  2 


Le..  than  high  school  graduation   

High  school  graduation  only   

fUss  than  two  years 
Vocational,  trade,  j1*3 

or  business  school    or  more  . 

titer  high  school  * lwo  ' 


01 
02 

03 

,  04 


{Less  than  two  years  of  college 
U  or  more  years*  college  _ 


{ 


(including  two  year 


College  program 


(Finished  college 

(four-  or  five-year  degree) 


05 


06 


{ 


07 
08 


{Master's  degree  or  equivalent  .... 
U.D,  .1.0. ,  or  other  advanced  degree  09 


26  502 


35.    Did  you  expect  to  go  to  college  when  you  were  in  the  following 
grades? 


(Circle  One  On  Bach  Line) 


When  you  were  .  .  . 

a.  In  the  6th  grade 

b.  In  the  7th  grade 

c.  In  the  8tl'  grade 

d.  In  the  9th  grade 

36.  Age: 
13  or  younger  14 


Yes 
.  1  . 
.  1  . 
.  1  . 
.  1  . 


No 
2  . 
2  . 
2  . 
2  . 


Was 

not 
sure 


Hadn't 
thought 
about  it 


3 
3 
3 
3 


4 
4 
4 
4 


15. 


(Circle  One) 
16       17  18 


19 


20 


21  or  older 


37.    Do  you  have  any  of  the  following  conditions? 

(Circle  All  That  Apply) 

a.  Specific  learning  disability   

b.  Visual  h*  tdicap   

c.  Hard  of  hearing   

d.  Deafness   

e.  Speech  disability   

f.  Orthopedic  handicap   

g.  Other  health  impairment  .«  


38.    Do  you  feel  that  you  have  a  physical  condition  that  limits  the 
kind  or  amount  of  work  you  can  do  on  a  job,  or  affects  your 
chances  for  more  education? 

(Circle  One) 


No 


Yes 


1 
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39.    We  would  like  to  ask  you  about  the  are*  of  the  world  your 
ancestors  lived  in  BEFORE  coming  to  America.    What  do  you 
consider  your  background?    If  your  ancestors  came  from  more  than 
one  area,  please  circle  below  the  one  area  you  consider  the  most 
important  part  of  your  background* 

(Circle  One) 


HISPANIC  OR  SPANISH 

Mexican  ,  01 

Cuban   02 

Puerto  Rican    03 

Other  Hispanic  (Write  In)   OA 

ASIAN  OR  PACIFIC  ISLANDER 

Chinese  ,  e  05 

Filipino  06 

Japanese    07 

Korean  ••••••   03 

Southeast  Asian 

(Vietnamese,  Laotian,  r^pjodian/Kampuchean,  etc.)    09 

Pacific  Islander   10 

Other  Asian    11 

NEITHER  HISPANIC  NOR  ASIAN  OR  PACIFIC  ISLANDER    12 
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40.  Did  anyone  at  hoot  read  to  you  when  you  were  young  before  you 

started  school? 

(Circle  One) 

Mever   .  01 

Less  than  once  a  month  02 

One  to  four  times  a  month  03 

Several  times  a  week   04 

Every  day   05 

Don't  remember   06 

41.  How  many  brothers  and  sisters  do  you  have  in  the  age  groups  below? 

Please  include  step-brothers  and  step-sisters  if  they  live,  or 
have  lived,  in  your  home* 

(Circle  One  On  Bach  Line) 

How  many  brothers  and 

sisters  do  you  have  Pive 
who  are.  .  .  None     One     Two     Three     Pour    or  more 

a.  Three  or  more  years 

older  than  you    01  ...  02  ..  03  ...  04  ...  05  ...  06 

b.  1-2  years  older    01  ...  02  ..  03  ...  04  ...  05  ...  06 

c.  Same  age  as  you    01  ...  02  ..  03  ...  04  ...  05  ...  06 

d.  1-2  years  younger   01  ...  02  ..  03  ...  04  ...  05  ...  06 

e.  Three  or  more  years 

younger   01  ...  02  ..  03  ...  04  ...  05  ...  06 

42.  Does  your  family  own  or  rent  the  house  or  apartment  in  which  you 

now  live? 

(Circle  One) 
Own   i 

Rent    2 

Other  arrangement   3 
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How  many  rooms  are  there  in  your  home?    Count  only  the  rooms  yo 
family  lives  in.    Count  the  kitchen  (if  separate)  but  not 


bathrooms. 

(Circle  One) 


*  06 


Which  of  the  following  do  you  have  in  your  home? 

(Circle  One  On  Bach  Line) 

Have          Do  not  have 
a*  A  specific  place  for  study   i    2 

b.  A  daily  newspaper   1    2 

c.  Encyclopedia  or  other 

reference  books    1    2 

d.  Typewriter   e#  \    2 

e.  Electric  dishwasher    1   ##a  2 

f •  Two  or  more  cars  or 

trucks  that  run   1   2 

g.  More  than  50  books    1  4  ####  2 

h.  A  room  of  your  own    \   2 

i.  Pocket  calculator   1   2 
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When  you  were  in  the  first,  sixth,  and  ninth  grades,  about  how 
many  of  the  students  in  your  class  were  Black? 

(Circle  One  On  Bach  Line) 

About 

pone       Few        half       Most  All 

a.  In  my  first  grade    1  ....  2   3  4  ....  5 

b.  In  my  sixth  grade   1  ....  2   3  4  ....  i 

c.  In  my  ninth  grade    '  ....  2   3  4  ....  5 


When  you  were  in  the  first,  sixth,  and  ninth  grades,  about  how 
many  of  the  students  in  your  class  were  Hispanic  (Mexican,  Cuban, 
Puerto  Rican,  Latino,  or  other  Spanish  descent;? 

(Circle  One  On  Bach  Line) 

About 

None       Pew        half       Most  All 

a.  In  my  first  grade  1  ....  2   3  4  ....  5 

b.  In  my  sixth  grade   1  ....  2   3  4  ....  5 

c.  In  my  ninth  grade    1  ....  2   3  4  ....  5 

When  you  were  in  the  first,  sixth,  and  ninth  grades,  about  how 
many  of  the  students  in  your  class  were  Asian/Pacific  Islander? 

(Circle  One  On  Each  Line) 

About 

None       Pew        half       Most  All 

a.  In  my  first  grade    1  ....  2  3  4  ....  5 

b    In  my  sixth  grade    1  ....  2   3  4  ....  5 

c.  In  oy  ninth  gratfe  *  1  ....  2  3   4  ....  5 
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48.    Do  you  plan  to  go  to  college  at  some  time  in  the  near  future? 

(Circle  On**) 


Ye*,  right  after  high  school    1 

Yes,  after  staying  out  one  year   2 

Yes,  after  a  longer  period  out  of  school    3 

Don't  know   4 

No   5 


ERJC 
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Item  A 

Twelfth  Grade  Questionnaire 
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Form  Approved 
O.M.B.  No.  185d-059J 
App.  Exp. J  6/30/1987 


TWELFTH  GRADE  QUESTIONNAIRE 

NELS:88 
NATIONAL  EDUCATION 
LONGITUDINAL 
STUDY  OF 
1988 
FIELD  TEST 


Prepared  for:  U.S.  Department  of  Education 

Center  for  Education  Statistics 

By:  NORC,  A  Social  Science  Research  Center 
University  of  Chicago 


As  a  matter  of  policy,  the  Center  for  Statistics  is  concerned  w'th  protecting  the  orivacy  of  individuals  who 
participate  in  voluntary  surveys.    We  want  to  let  you  know  tht.. 

1.  Section  406  of  the  General  Education  Provisions  Act  (2D-USC  1221e-1)  allows  us  to  ask  you  the  questions  in 
this  questionnaire. 

2.  You  may  skip  any  questions  you  do  not  wish  to  answer. 

5.     We  are  asking  you  these  questions  in  order  to  gather  information  about  what  happens  to  students  as  they 
move  out  of  high  school  and  make  decisions  about  postsecondary  education  and  wor1  . 

4.     Year  responses  will  be  merged  with  those  of  other  students,  and  the  answers  you  give  will  never  be 
identified  as  yours. 
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GENERAL  INSTRUCTIONS 


PLEASE  READ  EACH  QUESTION  CAREFULLY 

It  is  important  that  you  follow  the  directions  for  responding  to  each 
kind  of  question.    These  are: 

(CIRCLE  ONE) 

Wh&*  is  the  color  of  your  eyes? 

(CIRCLE  ONE) 

Brown    1  If  the  color  of  your 

Blue    2  eyes  is  green,  you 

Green   would  circle  the  three 

Another  Color    4  as  shown. 


(CIRCLE  A'T.  THAT  APPLY) 

Last  week,  did  you  do  any  of  the  following? 

(CIRCLE  ALL  THAT  APPLY) 

a.  See  a  play    1 

b.  Go  to  a  movie   (3D 

it  ....CD 


c.  Attend  a  sporting  event 


If  you  went  to  a  movie 
and  attended  a  sport- 
ing event  last  week, 
you  would  circle  two 
items  as  shown. 


(CIRCLE  ONE  ON  EACH  LINE) 

Do  you  plan  to  do  any  of  the  following  next  week? 

(CIRCLE  ONE  ONE  EACH  LINE) 


Yes  Not  Sure  No 

a.  Visit  a  relative   1  ...  2  .  • . .  JlP 

b.  Go  to  a  museum   1  ...  <£>....  3 

c.  Study  at  a 

friend's  house  £p  . . .  2  ....  3 


If  you  plan  to  study 
at  a  friend's  house, 
do  not  plan  to  visit  a 
relative,  and  are  not 
sure  about  going  to  a 
museum  next  week,  you 
would  circle  one  on 
each  line  as  shown. 


This  questionnaire  is  not  a  test.    We  hope  you  will  answer  every 
question,  but  you  may  skip  any  question  you  do  not  wish  to  answer. 
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WE  HOPE  YOU  WILL  ANSWER  EVERY  QUESTION,  BUT  YOU  MAY  SKIP  ANY  QUESTION 
YOU  DO  NOT  WISH  TO  ANSWER. 

1.  When  do  you  expect  to  graduate  from  high  school? 

(CIRCLE  ONE) 

I  will  leave  high  school  before  I  graduate    01 

Now  through  June  1987    02 

July  or  August  1987    03 

September  1987  through  January  1988    04 

Pebruary  through  June  1988    05 

After  June  1988   06 

2.  Which  of  the  following  best  describes  your  present  high  school 
program? 

(CIRCLE  ONE) 

General    01 

Academic  or  college  preparatory    02 

Vocational  (Occupational  preparation) 

Agricultural  occupations    03 

Business  or  office  occupations    04 

Distributive  education   05 

Health  occupations    06 

Home  economics  occupations    07 

Technical  occupations    08 

Trade  or  industrial  occupations    09 


1 


How  often  has  each  of  the  following  been  used  in  the  courses  you 
are  taking  this  year? 

(CIRCLE  OME  OH  EACH  LIME) 


Fairly 

Never    Seldom    often  Frequently 

a.  Listening  to  the 

teachers  lecture   1  . ...  2  3  4 

b.  Participating  in 

student-centered 

discussions    1  . ...  2  .....  3   4 

c.  Working  on  a  project 

or  in  a  laboratory   1  ....  2  3  4 

d.  Writing  essays,  themes, 

poetry,  or  stories    1  ....  2  3  4 

e.  Having  individualized 

instruction  (snail  groups 
or  one-to-one  with 

a  teacher)    1  ....  2  ......  3  4 

f .  Using  teaching  machines 

or  computer-assisted 

instructions    1  ....  2  3  4 


2 
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Starting  with  the  beginning  of  the  tenth  grade  and  through  the  end 
of  this  school  year  how  much  course  work  will  you  have  taken  in 
each  of  the  following  subjects? 

Count  only  courses  that  meet  at  least  three  times  (or  three 
periods)  a  week. 

(CXSCLE  ONE  ON  EACH  LINE) 

More 
than 

1/2      1      1  1/2     2      2  1/2      3  3 
None    year  year  years  years  years  years  years 


a. 

Mathematics 

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

• 

•  • 

08 

b. 

English  or 
literature 

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

• 

•  • 

08 

c. 

French   

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

• 

•  • 

08 

d. 

German   

•  •  •  • 

01 

..  02 

• 

03 

•  t 

04 

•  • 

OS 

•  • 

06 

• 

07 

• 

•  • 

08 

e. 

Spanish  . ... 

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

• 

•  • 

08 

f . 

History  or 
social 
studies  ... 

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

• 

08 

8- 

Science  •••• 

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

•  t 

»  • 

08 

h. 

Business, 
office,  or 
sales   

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

05 

•  • 

06 

• 

07 

•  « 

08 

i  • 

Trade  and 
industry 

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

*  i 

• 

08 

J- 

Technical 
courses 

•  •  •  • 

01 

..  02 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

•  • 

• 

08 

k. 

Other 
vocational 
course* 

•  •  •  • 

01 

..  o; 

• 

03 

•  • 

04 

•  • 

OS 

•  • 

06 

• 

07 

•  • 

• 

08 
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Which  of  the  following  courses  have  you  taken,  counting  the  courses 
you  are  taking  this  semester? 

(CIRCLE  OME  OH  EACH  LIME) 

Yes,  No,  have 

have  taken  not  taken 

a.  First-year  algebra   1   2 

b.  Second-year  algebra    1   2 

c.  Geometry   1   2 

d.  Trigonometry   1   2 

e.  Calculus    1   2 

f.  Physics    1   2 

g.  Chemistry    1   2 

Which  of  the  following  best  describes  your  grades  so  far  in  high 
school? 

(CIRCLE  OME) 

Mostly  A  (a  numerical  average  of  90-100)    01 

About  half  A  and  half  B  (85-89)    02 

Mostly  B  (80-84)    03 

About  half  B  and  half  C  (75-79)    04 

Mostly  C  (70-74)    05 

About  half  C  and  half  D  (65-69)    06 

Mostly  n  (60-64)    07 

Mostly  below  D  (below  60)    08 
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Circle  all  the  statements  that  apply  for  each  of  the  subjects 
listed  below. 

(CIRCLE  ALL  THAT  APPLY) 

A.  Mathematics 

a.  I  got  mostly  A9s  and  B9s  in  this  subject  ...  1 

b.  It  will  be  useful  in  my  future   1 

c.  It  was  interesting  to  me  «•••  1 

d.  Took  no  mathematics  courses    1 

B.  English  or  literature 

a.  I  got  mostly  A9s  and  B9s  in  this  subject  ...  1 

b.  It  will  be  useful  in  my  future   1 

c.  It  was  interesting  to  me    1 

d.  Took  no  English  or  literature  courses    1 

C.  Business,  office,  or  sales 

a.  I  got  mostly  A9s  and  B9s  in  this  subject  ...  1 

b.  It  will  be  useful  in  my  future   1 

c.  It  was  interesting  to  me   1 

d.  Took  no  business  courses    1 

D.  Trade  or  industry 

a.  I  got  mostly  A9s  and  B9s  in  this  subject  ...  1 

b.  It  will  be  useful  in  my  future   1 

c.  It  was  interesting  to  me    I 

d.  Tool  no  trade  or  industrial  courses   1 
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Have  you  ever  been  in  any  of  the  following  kinds  of  courses  or 
programs? 

(CIRCLE  OMB  OH  EACH  LIME) 
Yes  No 

a.  Remedial  English 

(sometimes  called  basic  or  essential)    1  ••••  2 

b.  Remedial  Mathematics 

(sometimes  called  basic  or  essential)    1  ••••  2 

c.  Advanced  or  honors  program  in  English   1  ....  2 

d.  Advanced  or  honors  program  in  Mathematics    1  ••••  2 

e.  Bilingual  or  bicultural  program   1  ....  2 

f.  Family  life  or  sex  education  c..  1  ....  2 

g.  Alcohol  or  drug  abuse  education    1  ....  2 

h.  Special  program  for  the 

educationally  handicapped    1  ....  2 

i.  Special  program  for  the 

physically  handicapped    1  ....  2 

Approximately  what  is  the  average  amount  of  time  you  spend  on 
homework  a  week? 

(CIRCLE  OME) 

No  homework  is  ever  assigned   01 

I  have  homework,  but  I  don't  do  it   02 

Less  than  1  hour  a  week   03 

Between  1  and  3  hours  a  week   04 

More  than  3  hours,  less  than  5  hours  a  week    05 

Between  5  and  10  hours  a  week  06 

More  than  10  hours  a  week  07 

6 
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10.    Between  tht  beginning  of  school  last  fall  and  Christmas  vacation, 
about  how  nuny  days  were  you  absent  from  school  for  any  reason, 
not  counting  illness? 

(CIRCLE  ONE) 

None    01 

I  or  2  days    02 

3  or  4  days    03 

S  to  10  days    04 

II  to  IS  days    OS 

16  to  20  days    06 

21  or  more    07 

11 •    Between  the  beginning  of  school  last  fall  and  Christmas  vacation, 
about  how  many  days  were  you  late  to  school? 

(CIRCLE  ONE) 

None    01 

I  or  2  days    02 

3  or  4  days    03 

S  to  10  days   04 

II  to  IS  days    OS 

16  to  20  days    06 

21  or  more    07 


7 
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How  old  were  you  when  you  first  worked  for  pay,  not  counting  work 
around  the  house? 

(CIRCLE  ONE) 

11  or  younger   01 

12    02 

13    03 

1«   OA 

15    05 

"    06 

17   07 

18  08 

19  09 

20  or  older    10 

Never  have  worked  for  pay    H 

Did  you  do  any  work  for  pay  last  week,  not  counting  work  around 
the  house? 

(CIRCLE  ONE) 

Yes    l 

No  2 

Were  you  looking  for  a  job  last  week? 

(CIRCLE  ONE) 

Yes    1 

No  2 
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15.  When  was  the  most  recent  time  you  worked  for  pay,  not  counting 

work  around  the  house? 

(CIRCUS  OMB) 

Never  worked  for  pay   01 

Last  week    02 

Within  the  past  month,  not  last  week   03 

Within  the  past  3  ninths    OA 

Since  school  started  last  fall    OS 

Last  summer  ,   06 

Before  that    07 

16.  How  many  hours  do/did  you  work  a  week  on  your  current  or  most 

recent  job? 

(CIRCLE  OMB) 

None,  never  worked  for  pay   01 

1*4  hours  per  week  .   02 

5-14  hours  per  week    03 

15*21  hours  per  week    04 

22*29  hours  per  week    05 

30*34  hours  per  week    06 

35  hours  or  more  per  week  *   07 
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Which  of  the  job  categories  below  cornea  close  i  to  the  kind  of 
work  you  do/did  for  pay  on  your  current  or  most  recent  job?  (If 
aore  than  one  kind  of  work,  choose  the  one  which  paid  you  the 
most  per  week.) 

(CIRCLE  OWE) 

Have  not  worked  for  pay   01 

Lawn  work  or  odd  jobs   #   02 

Waiter  or  waitress  in  a  restaur*  ,t  or  drive-in   03 

Babysitting  or  child  care  _   04 

Para  or  agricultural  work   05 

Pacto/y  work,  unskilled  or  semi-skilled  ,  06 

Skilled  trade    07 

Other  manual  labor   08 

Store  clerk  or  salesperson   09 

Office  or  clerical  f   \q 

Hospical  or  health    H 

Other    12 


10 
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18.    Have  you  participated  in  any  of  the  following  types  of  activities 
eithar  in  or  out  of  school  this  year? 


(CIRCLE  OHB  OH  BACH  LINE) 

Have 

participated 

actively  Have 

Have  (but  not  participated 

not  as  a  leader  as  a  leader 

participated     or  officer)  or  officer 


a.  Varsity  athletic 

teams    1 

b.  Other  athletic 

teams  -  in  or 

out  of  school   1 


c.  Cheer  leaders, 

pep  club, 

majorettes    1    2    3 

d.  Debating  or  drama   1   2  <   3 

e.  Band  or  orchestra    1    2    3 


f.  Chorus  or  dance   1   2    3 

g.  Hobby  clubs  such 

as  photography, 
model  building, 
hot  rod, 
electronics, 

crafts    1   2    3 


h.  Honorary  clubs, 
such  as  Beta 
Club  or  National 
Honor  Sc-iety    1 

f. •  School  newspaper, 
magazine, 

yearbook,  annual    1 


j.  School  subject- 
matter  clubs, 
such  as  science, 
history,  language , 

business,  art    1    2    3 


Continued,  next  page 
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(CIRCLE  ONE  ON  EACH  LINE) 


Have 
participated 


actively 
Have  (but  not 


Have 
participated 
as  a  leader 
or  officer 


not  as  a  leader 

participated     or  officer) 


Student  council, 
student  government, 
political  club  •••• 


1 


2 


3 


Vocational 
education  clubs, 
such  as  Puture 
Homemakers, 
Teachers,  Farmers 
of  America,  OECA, 

PBLA,  or  VICA   1   2    3 

Youth  organisations 
in  the  community, 

such  as  Scouts,  Y,  etc.    1  2    3 

Church  activities, 
including  youth 

groups    1    2    3 

Junior  Achievement   1  2    3 
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19.    Please  describe  below  the  job  most  recently  held  by  your  father 
(stepfather  or  male  guardian),  even  if  he  is  not  working  at 
preser" > 


(WRITE  IN)  

Which  of  the  categories  below  comes  closest  to  describing  that  job? 

(CIRCLE  OMB) 

Do  not  live  with  father  (stepfather  or  male  guardian)   01 

CLERICAL  such  as  bank  teller,  bookkeeper,  secretary, 

typist,  mail  carrier,  ticket  agent    02 

CRAFTSMAN  such  as  baker,  automobile  mechanic,  machinist-, 

painter,  plumber,  telephone  installer,  carpenter    03 

FARMER,  FARM  MANAGER  ,  04 

HOMEMAKER  OR  HOUSEWIF     MLY  05 

LABORER  such  as  con*  on  worker,  car  washer,  sanitary 

worker,  farm  labore*   ,  ,  \  06 

MANAGER,  ADMINISTRATOR  such  as  sales  manager,  office 

manager,  school  administrator,  buyer,  restaurant  manager, 
government  official    07 

MILITARY  such  as  career  officer,  enlisted  man  or  woman  in 

the  Armed  Forces    08 

Continued,  next  page 
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OPERATIVE  such  as  meat  cutter,  assembler,  machine  operator, 

welder,  taxicab,  bus,  or  truck  driver    09 

PROFESSIONAL  such  as  accountant,  artist,  registered  nurse, 
engineer,  librarian,  writer,  social  worker,  actor,  actress, 
athlete,  politician,  but  not  including  school  teacher    10 

PROFESSIONAL  such  as  clergyman,  dentist,  physician,  lawyer, 

scientist,  college  teacher    n 

PROPRIETOR  OR  OWNER  such  as  owner  of  a  small  business, 

contractor,  restaurant  owner    12 

PROTECTIVE  SERVICE  such  as  detective,  police  officer  or  guard, 
sheriff,  fire  fighter   13 

SALES  such  as  salesperson,  advertising  or  insurance  agent, 

real  estate  broker   14 

SCHOOL  TEACHER  such  as  elementary  or  secondary   15 

SERVICE  such  as  barber,  beautician,  practical  nu~se,  private 

household  worker,  janitor,  waiter   .  16 

TECHNICAL  such  as  draftsman,  medical  or  dental  technician, 

computer  programmer  ,   17 

Never  worked    18 

Don't  know  •  ••   19 


ERLC 
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20.  Please  describe  below  the  job  most  recently  held  by  your  mother 
(stepmother  or  female  guardian),  even  if  she  is  not  working  at 
present. 


(WRITS  IN) 


Which  of  the  categories  below  com£s  closest  to  describing  that  job? 

(CIRCLE  OMB) 


Do  not  live  with  mother  (stepmother  or  female  guardian)   01 

CLERICAL  such  as  bank  teHer,  bookkeeper,  secretary, 

typist,  mail  carrier,  ticket  agent    02 

CRAFTSMAN  such  as  baker,  automobile  mechanic,  machinist, 

painter,  plumber,  telephone  installer,  carpenter    03 

PARMER,  PARM  MANAGER    04 

HO  ME  MAKER  OR  HOUSEWIFE  ONLY    05 

LABORER  such  as  construction  worker,  car  washer,  sanitary 

worker,  farm  laborer    06 

MANAGER,  ADMINISTRATOR  such  as  sales  manrger,  office 

manager,  school  administrator,  buyer,  restaurant  manager, 
government  official  *   07 

MILITARY  such  as  career  officer,  enlisted  man  or  woman  in 

the  Armed  Forces    08 


Continued,  next  page 
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OPERATIVE  such  as  meat  cutter,  assembler,  machine  operator, 

welder,  taxicab,  bus,  or  truck  driver    09 

PROFESSIONAL  such  as  accountant,  artist,  registered  nurse, 
engineer,  librarian,  writer,  social  worker,  actor,  actress, 
athlete,  politician,  but  not  including  school  teacher    10 

PROFESSIONAL  such  as  clergyman,  dentist,  physician,  lawyer, 

scientist,  college  teacher   n 

PROPRIETOR  OR  OWNER  such  as  owner  of  a  small  business, 

contractor,  restaurant  owner   12 

PROTECTIVE  SERVICE  such  as  detective,  police  officer  or  guard, 
sheriff,  fire  fighter    13 

SALES  such  as  salesperson,  advertising  or  insurance  agent, 

real  estate  broker    14 

SCHOOL  TEACHER  luch  as  elementary  or  secondary    15 

SERVICE  such  as  barber,  beautician,  practical  nurse,  private 

household  worker,  janitor,  waiter    16 

TECHNICAL  such  as  draftsman,  medical  or  dental  technician, 

computer  programmer   ,   17 

Never  worked    18 

Don't  know   19 
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21 •    What  was  the  highest  level  of  education  your  father  (stepfather  or 
male  guardian)  completed? 

(circle  am) 


Do  not  live  with  father  (stepfather  or  male  guardian)    01 

Less  than  high  school  graduation   02 

High  school  graduation  only    03 


Vocational,  trade,  {Less  than  two  years    04 

or  business  school   { 

after  high  school  {Two  years  or  more  OS 


{Less  than  two  years  of  college  06 

{Two  or  more  years  of  college 

(including  two  year  degree)  ••••  07 

College  program  {Finished  college 

.four-  or  five-year  degree)  ••••  08 

{Master's  degree  or  equivalent  •••  09 

{Ph.D,  M.D. ,  or 
other  advanced  degree   10 

Don 9 1  know   11 

22.    How  much  of  his  life  has  your  father  (stepfather  or  male  guardian) 
spent  in  the  United  States? 

(CIRCLE  ONE) 

All  or  almost  all    01 

More  than  20  years,  but  not  all    02 

About  11-20  years    03 

About  6*10  years  04 

About  1-5  years    05 

Don't  know    08 
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23.    What  was  the  highest  level  of  education  your  mother  (stepmother  or 
female  guardian)  completed? 

(CIRCLE  ONE) 

Do  not  live  with  mother  (stepmother  or  female  guardian)   01 

LrCrfi  than  high  school  graduation    02 

High  school  graduation  only  ,  03 


Vocational,  trade,  {Less  than  two  years    04 

or  business  scnool   { 

after  high  school  {Two  years  or  more    05 


{Less  than  two  years  ol  college    06 

{Two  or  more  years  of  college 

(including  two  year  degree)   07 

College  program  {Finished  college 

(four-  or  five-year  degree)    08 

{Master's  degree  or  equivalent    09 

{Ph.D,  M.D.,  or  other  advanced  degree  10 

Don1 1  know  •  •  •  •   11 


24.    How  much  of  her  life  has  your  mother  (stepmother  or  female 
guardian)  spent  in  the  United  States? 

(CIRCLE  ONE) 


All  or  almost  all    01 

More  than  20  years,  but  not  all    02 

About  U-20  years    03 

About  6-10  years    %\ 

About  1-5  years  05 

Don't  know   06 
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25.  Were  you  born  in  the  United  States? 

(CIRCLE  ONE) 
Yes    1 

Mo   2 

26.  How  much  of  your  life  have  you  spent  in  the  United  States? 

(CIRCLE  OdK) 
All  or  almost  all    1 

More  than  10  years f  but  not  all   2 

About  6-10  years    3 

About  1-5  years   4 


27.    Are  the  following  statements  about  your  parents  true  or  false? 

(CIRCLE  ONE  OH  EACH*  LINE) 

Does 
Not 

True  False  Apply 

a.  My  mother  (stepmother  or 

female  guardian)  keeps 
close  track  of  hov  veil 

I  am  doing  in  school    1   2  ••••  3 

b.  My  father  (stepfather  or 

male  guardian)  keeps 
close  track  of  how  veil 

I  am  doing  in  school    1   2   3 

c.  My  parents  (or  guardians) 

almost  alvays  know  vhere 

I  am  and  what  I'm  doing   1   2  .........  3 
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28.    During  weekdays  about  how  many  hours  per  day  do  you  watch  TV? 

(CIRCLE  ONE) 

Don't  watch  TV  during  week   01 

Less  than  1  hour    02 

1  hour  or  more,  less  than  2   03 

2  hours  or  more,  less  than  3   04 

3  hours  or  more,  Less  than  4   05 

4  hours  or  more,  less  than  5   06 

5  or  more    07 


29*  How  much  has  each  of  the  following  persons  influenced  your  plans 
for  after  high  school? 

(CIRCLE  ONE  ON  EACH  LIVE) 


a.  Your  father  

b.  Your  mother   

c.  A  guidance  counselor 

d.  Teachers  ,   


e.  Friends  or  relatives 
about  your  own  age  . 

f •  Military  recruiters  . 

g.  College  recruiters  •. 


Not 
At 


Somewhat 


2 
2 
2 
2 

2 
2 
2 


A 

Great 
Deal 
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30.    How  do  you  feel  About  each  of  the  following  statements? 


Agree 
strongly 


a.  I  take  a  positive 
attitude  toward 
myself   


b.  Good  luck  is  more 

important  than 

hard  work  for 

success    1 

c.  I  feel  I  am  a 

person  of  worth, 
on  an  equal  plane 
with  others    1 

d.  I  am  able  to  do 

things  as  well  as 

most  other  people  ...  1 

e.  Every  time  I  try  to 

get  ahead,  something 
or  somebody  stops  me  1 

f.  Planning  only  makes  a 

person  unhappy i  since 
plans  hardly  ever 
work  out  anyway   1 


(CIRCLE  ONE  Oil  EACH  LIMB) 

Di  sagree 

Agree     Disagree  strongly 


g.  People  who  accept 
their  condition  in 
life  are  happier 
than  those  who  try 
to  change  things  . ....  1    2 


i.  What  happens  to  me 

is  my  own  doing    1 


j.  At  times  I  think  I 

am  no  good  at  all  ....  1   2 


h.  On  the  whole,  I  am 

satisfied  with  myself    1   2    3 


No 
opinion 


Continued ,  next  page 
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(CIRCLE  OMB  ON  BACH  LIMB) 

Agree  Disagree  No 

strongly     Agree     Disagree     strongly  opinion 

k.  When  I  make  plans , 
I  am  almost  certain 

I  can  make  then  work..  1    2  3   4   5 

i.  I  feel  I  do  not  have 

much  to  be  proud  of       1    2    3  4   5 


31.    Are  the  following  statements  about  your  experience  in  school  true 
or  false? 

(CIRCLE  OHB  ON  BACH  LIMB) 


True  Palse 

a.  I  am  satisfied  with  the 

way  my  education  is  going   . .  1   2 

b.  I  have  had  disciplinary  problems 

in  school  during  the  last  year   1   2 

c.  I  am  interested  in  school    1   2 

d.  I  have  been  suspended  or 

put  on  probation  in  school    1   2 

e.  Every  once  in  a  while  I  cut  a  class    1   2 

f.  I  don't  feel  safe  at  this  school   1   2 
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32.    Write  in  here  the  name  of  the  job  or  occupation  that  you  expect  or 
plan  to  have  when  you  are  30  years  old.    Even  if  you  are  not  at 
all  sure,  write  in  your  best  guess. 

(WRITE  IN)  


Which  of  the  categories  below  cones  closest  to  describing  that  job? 

(CIRCLE  OTO) 


CLERICAL  such  as  bank  teller,  bookkeeper,  secretary, 

typist,  mail  carrier,  ticket  agent   01 

CRAFTSMAN  such  as  baker,  automobile  mechanic,  machinist, 

painter,  plumber,  telephone  installer,  carpenter    02 

PARMER,  FARM  MANAGER  «   03 

HOMEMAKER  OR  HOUSEWIFE  ONLY    04 

LABORER  such  as  construction  worker,  car  washer,  sanitary 

worker,  farm  laborer   „  OS 

MANAGER,  ADMINISTRATOR  such  as  sales  manager,  office 

manager,  school  administrator,  buyer,  restaurant  manager, 
government  official    06 

MILITARY  such  as  career  officer,  enlisted  man  or  woman  in 

the  Armed  Forces    07 
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OPERATIVE  such  as  meat      tter,  assembler,  machine  operator, 

welder,  taxi cab,  bus,  or  truck  drivev    08 

PROFESSIONAL  sue*  is  eccountant,  artist,  registered  ivirse, 
engineer,  librarian,  writer,  social  worker,  actor,  actress, 
athlete,  politician,  but  not  including  school  teacher    09 

PROFESSIONAL  such  as  clergyman,  dcitist,  physician,  lawyer, 

scientist,  college  teacher   10 

PROPRIETOR  OR  OWNER  such  *s  owner  of  l  .mall  business, 

contractor,  restaurant  owner  ,    \\ 

PROTECTIVE  SERVICE  such  as  detective,  polic-  officer  or  guani, 
sheriff,  fire  fighter  f   12 

SALES  such  as  salesperson,  advertising  or  insurance  agent, 

real  estate  broker   h   13 

SCHOOL  TEACHER  such  as  elementary  or  secondary    14 

SERVICE  such  as  barber,  beautician,  practical  nurse,  private 

household  worker,  janitor,  waiter    15 

TECHNICAL  such  as  draftsman,  medical  or  dental  technician, 

computer  programmer   16 

NOT  WORKING   17 
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33.  As  things  stand  now,  how  far  in  school  do  you  think  you  will  get? 

(CIRCLE  ONE) 

Less  then  high  school  graduation  4   01 

High  school  graduation  only   02 

Vocational,  trade,  {Less  than  two  years  , ...  03 

or  business  school   { 

after  high  school  {Two  years  or  more    04 

{Lest  than  two  years  of  college  OS 

{Two  or  more  years  of  college 
(including  two  year  degree)   06 

College  program  {Finish  college 

(four-  or  five-year  degree)    07 

{Master's  degree  or  equivalent    08 

{ 

{Ph.D,  M.D.,  or  other  advanced  degree  J9 

34.  What  is  the  lowest  levei  of  education  you  would  be  satisfied  with? 

(CIRCLE  OMB) 

Less  than  high  school  graduation   01 

High  school  graduation  only   02 

Vocational,  trade,  {Less  than  two  years    03 

or  business  school   { 

after  high  school  {Two  years  or  more   *.  04 

{Less  than  two  years  of  college    OS 

{TWo  or  more  years  of  college 

(including  two  year  degree)   06 

College  program  {Finished  college 

(foui-  or  five-year  degree)    07 

{Master's  degree  or  equivalent    08 

{Ph.D,  M.D. ,  or  other  advanced  degree  09 

25 
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35.    Di<*  you  expect  to  go  to  college  when  you  were  in  the  following 
grades? 

(CIRCLE  OMB  Oil  BACH  LIME) 


When  you  were  •  •  • 


Was  Hadn't 
not  thought 
Yes  No  sure  about  it 


a.  In  the  8th  grade  ...  1    2    3   4 

b.  In  the  9th  grade  ...  1    2  3   4 

c.  In  the  10th  grade  ..  1    2   3   4 

d.  In  the  11th  grade  ..  1    2  3   4 


36.    What  is  the  one  thing  that  most  likely  will  take  the  largest  share 
of  youv  time  Ta  the  year  after  you  leave  high  school? 

(CIRCLE  OME) 

Working  full  tine   01 

Entering  an  apprenticeship  or 

on-the-job  training  program  •   02 

Coing  into  regular  military  service 

(or  service  academy)    03 

Being  a  full-time  homemaker   „  04 

Taking  vocational  or  technical 
courses  at  a  trade  or  business 

school  full  time  or  part  tim:    05 

Taking  academic  ~ purses  at  a  junior 
or  community  college  full  time 

or  part  time    06 

Taking  technical  or  vocatonal 

subjects  at  a  junior  or  community 

college  full  time  or  part  time    07 

Attending  a  four-year  college  or 

university  full  time  or  part  time  •   08 

Working  part  time,  but  not 

attending  school  or  college    09 

Other  (travel,  take  a  break,  no  plans)    10 


26 


37.    About  how  much  money  do  you  expect  to  earn  from  work  in  the 
year  beginning  July  1987  end  tr  'ing  June  1988? 

(CIRCLE  OMB) 


None    01 

Lett  then  f',000    02 

$l,000-$2,*99   03 

$3,000-$4,999    04 

$5,000-$6,999    05 

$7,000-$8,999   «   06 

$9,000-$10,999    07 

$11,000-$12,999   08 

$13, 000-$ 14, 999    09 

$15,000  or  more   10 

38.  Age: 

(CIRCLE  OMB) 

15  or  younger     16       17       18       19       20       21  or  older 
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39.    Do  you  lu  ve  any  of  the  following  conditions? 

(CIRCLE  ALL  THAT  APPLY) 

a.  Specific  learning  disability    1 

b.  Visual  handicap    1 

c.  Hard  of  hearing   1 

d.  Deafness    1 

e.  Speech  disability    1 

f .  Orthopedic  handicap    1 

g.  Other  health  impairment   1 
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40.    We  would  like  no  ilk  you  about  the  area  *>f  the  world  your 
ancestors  lived  in  BEFORE  coaing  to  America.    What  do  you 

consider  your  background?    If  your  ancestors  cane  from  more  than 

one  area,  please  circle  below  the  one  area  you  consider  the  most 
important  part  of  your  background. 

(CIRCLE  QUE) 

HISPANIC  OR  SPANISH 

Mexican    01 

Cuban    02 

Puerto  Rican    03 

Other  Hispanic  (Write  In)    04 

ASIAN  OR  PACIFIC  ISLANDER 

Chinese    05 

Filipino     .   06 

Japanese   *.   07 

Korean  •   Q8 

Southeast  Asian 

(Vietnamese,  Laotian,  Cambodian/Kampuchean,  etc.)    09 

Pacific  Islander    10 

Other  Asian    \\ 

NEITHER  HISPANIC  NOR  ASIAN  OR  PACIFIC  ISLAND   12 
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41.    Did  anyone  at  home  read  to  you  when    ou  were  young  before  you 
started  school? 

(CIRCLE  0MB) 

Never   r  .....  01 

Less  than  once  a  month   02 

One  to  four  tines  a  month   03 

Several  times  a  week  04 

Every  day   05 

Don '  t  remember  <  , . . . .  06 


42.    How  uiny  brothers  and  sisters  do  you  have  in  the  age  groups  belo*:? 
Please  include  step-brothers  and  step-sisters  if  they  live,  or 
have  lived,  in  your  home. 

(CIRCLE  ONE  ON  EACH  LIMB) 

How  many  brothers  and 

sisters  do  you  have  Five 
who  are.  .  .  None     One     Two     Three     Pour    or  more 

a.  Three  or  more  years 


...  02 

..  03 

...  04 

...05 

...  06 

b. 

...02 

..  03 

...04 

...  05 

...  06 

c. 

...  02 

..  03 

...  04 

...05 

...  06 

d. 

...01 

...  02 

..  03 

...  04 

...  05 

...  06 

e. 

Three  or  more  years 

...  02 

..  03 

...  04 

...05 

...  06 
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43.    Which  of  the  following  do  you  have  in  your  home? 

(CIRCLE  OMR  ON  EACH  LINE) 
Have  Do  not  have 

a.  A  specific  place  to  study  «   1   2 

b.  A  daily  newspaper   1   % 

c.  Encyclopedia  or  other 

reference  books.   1  ,  2 

d.  Typewriter  »   1  ##<  2 

e.  Electric  dishwasher   1   2 

f .  TWo  or  more  cars  or 

trucks  that  run   1   2 

g.  More  than  50  books   t..  1   2 

h.  A  room  of  you*  own   1   2 

i.  Pocket  calculator   1   2 


44.    When  you  were  in  the  first,  sixth,  and  ninth  grades,  about  how 
many  of  the  rtudents  in  your  class  were  Black? 

(CIRCLE  ONE  ON  EACH  LIME) 
About 


None 

Pew 

half 

Moat 

All 

a. 

In 

..  2  ... 

..  3  ... 

...  A  .. 

..  5 

b. 

In 

..  2  ... 

..  3  ... 

...  A  .. 

..  5 

c. 

In 

  1  .. 

..  3  ... 

...  A  .. 

..  5 
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45.    When  you  were  in  the  first,  sixth,  and  ninth  grades,  about  how 

many  of  Che  students  in  your  class  were  Hispanic  (Mexican,  Cuban, 
Puerto  Rican,  Latino,  or  other  Spanish  descent)? 


None 

a.  In  my  first  grade   1  . . 

b.  In  my  sixth  grade   1  . . 

c.  In  my  ninth  grade   1 


CIRCLE  OMB  OH  BACH  *.IME) 


About 

Few 

h«.  If 

Most  All 

2  .. 

...  3  ... 

2  .. 

...  3  ... 

46.  When  you  were  in  the  first,  sixth,  and  ninth  grades,  about  how 

many  of  the  students  in  your  class  were  Asian/Pacific  Islander? 

(CIRCLE  ONE  OH  EACH  LIMB) 

About  * 

None       Few        half       Most  All 

a.  In  my  first  grade   1  ....  2  3  4  ••••  5 

b.  In  my  sixth  grade   1  ....  2  3  4  ....  5 

c.  In  my  ninth  grade   1  ••••  2  3  4  ••••  5 

47.  Do  you  plan  to  go  to  college  at  some  time  in  the  near  future? 

(CIRCLE  OMB) 

Yes,  next  year    1 

Yes,  after  staying  out  one  year    2 

Yes,  after  a  longer  period  out  of  school   3 

Don't  know   4 

No    5 
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Item  5 
Parent  Questionnaire 
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PARENT  QUESTIONNAIRE 

NELS:88 
NATIONAL  EDUCATION 
LONGITUDINAL 
STUDY  OF 
1988 
FIELD  TEST 


NORC-4456 
form  Aooroved 
0..1.3.  No.  '358-3595 


Prepared  for-  U.S.  Department  of  Education 

Center  for  Education  Statistics 

By:  NORC,  A  Social  Science  Research  Center 
University  of  Chicago 


BEGIN  DECK  01 
01-07/ 
08/ 


As  a  matter  of  policy,  tha  Center  for  Statistics  is  concerned  with  protecting  the  privacy  of  individuals  *ho 
participate  in  voluntary  surveys.   Ue  want  to  let  you  know  that: 

1.  Section  406  of  the  General  Education  Provisions  Act  (26-USC  1221e-1)  allows  us  to  ask  /ou  the  questions  m 
this  questionnaire. 

2.  You  .My  skip  any  questions  yru  do  not  wish  to  answer. 

3.  Ue  are  asking  you  these  questions  in  order  to  gather  information  about  what  happens  to  students  as  they 
move  out  of  high  school  and  make  decisions  about  postsecondary  education  and  work. 

4.  Your  responses  will  be  merged  with  those  of  others,  and  the  answers  you  give  will  never  be  identified  as 
yours. 


ERLC 


On  the  cover  of  this  questionnaire  you  will  find  the  name  of  an  eighth 
grader.    Please  check  the  cover  to  insure  that  the  child  named  on  the  cover  is 
one  for  which  you  or  your  spouse  or  partner  are  responsible.    The  questionnaire 
should  be  completed  by  the  parent  or  guardian  who  is  most  familiar  with  the 
student's  current  school  situation  and  educational  plans.    It  you  are  the 
appropriate  person,  please  fill  out  the  questionnaire  and  return  it  in  the 
postage  paid  envelope  provided.    If  neicher  you  nor  your  spouse  or  partner  are 
the  appropriate  person,  please  call  Lee  Talbert  collect  at  (312)  702-8998,  to 
discuss  the  best  way  to  get  the  questionnaire  to  the  appropriate  person,  so  that 
they  may  respond. 
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GENERAL  INSTRUCTIONS 


PLEASE  READ  EACH  QUESTION  CAREFULLY 

It  is  important  that  you  follow  the  directions  for  responding  co  each  kind  of 
question.    These  are: 

(CIRCLE  ONE) 


What  is  the  color  of  your  eyes? 

(CIRCLE  ONE) 

Hf0wn   *   1  If  the  color  of  your 

Blue    •>  • 

Cr„n  eves  19  green,  you 

Green  ....    w0uU  circle  ^ 

Another  Color    4  „  sh0wn. 


(CIRCLE  ALL  THAT  APPLY) 

Last  week,  did  you  do  any  of  the  following? 

(CIRCLE  ALL  THAT  APPLY) 

a.  See  a.  play   i  If  y0u  went  tQ  &  n0vU 

b.  Co  to  a  movi  O  and  attended  a  rport- 

c.  Attend  a  sporting  event  ....Q  ing  event  last  week, 

you  would  circle  two 
items  as  shown. 


(CIRCLE  ONE  ON  EACH  LINE) 

Do  you  plan  to  do  any  of  the  following  next  week? 

(CIRCLE  ONE  ON  EACH  LINE) 


a 


If  you  plan  to  work  at  a 
.  Xil  Not  Sure  No    part-time  job,  do  not  plan 

Visit  a  relative    1  ...  2  ....ID  to  visit  a  relative,  and  are 

b.  Go  to  a  museum   1  ...(£....  3    not  sure  about  going  to  a  museum 

c.  Work  at  a  part-  next  week>  y0u  w0uU  circle  one 

time  J°b  •  (P.-.  2  ....  3    on  each  line  as  shown. 


T»iis  questionnaire  is  not  a  test.  We  hope  you  will  answer  every  question,  but 
you  may  skip  any  question  you  do  not  wish  to  answer. 
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NELS  88:  FIELD  TEST  PARENT  QUESTIONNAIRE 

PART-1  YOUR  FAMILY'S  BACKGROUND 
What  is  your  relationship  to  the  student  named  on  the  front  cover? 

A.  (CIRCLE  ONE) 
ft 

Mother   01  09-10/ 

Stepmother  „   02 

Father   03 

Stepfather  „   04 

Grandmother   05 

Grandfather   06 

Other  male  relative  or 

guardia:   07 

Other  female  relative  or 

guardian   08 

B.  Does  the  child  named  on  the  cover  live  with  you? 
ft 

(CIRC«*E  ONE) 

All  of  the  time   1  11/ 

More  than  half  of  the  time  2 

Less  than  half  of  the  time   3 

None  of  the  time  4 

Altogether9  how  many  people  are  dependent  upon  you  (or  you  and  your 
spouse/partner)?    Count  everyone  (include  individuals  not  living  with  you 
and  your  spouse /pirtner )  who  receives  one-half  or  more  of  their  financial 
support  from  you  or  your  spouse/partner,  but  do  not  include  yourself  or  your 
spouse/ partner* 

Total  number  of  dependents:  |  |  |  12-13/ 

(Not  counting  you  or  your  husband/wife) 
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We  would  like  to  know  how  many  brothers  and  sisters  your  eighth  grade 
student  has*    Please  include  stepchildren  if  they  live  in  your  home. 

(circle  omb) 


None   0  4/ 

One    1 

Two   2 

Three   3 

Four  4 

Five  „  5 


Six  or  more  6 

How  many  of  the  children  referred  to  in  question  3  are  older  than  your 
eighth  grader?    Please  include  stepchildren  if  they  live  or  have  lived  in 
your  home. 

(CIRCLE  ONE) 


None   0  15/ 

One  ,   1 

Two   2 

Three    3 

Four  4 

Five    5 

Six  or  more   6 


How  many  of  your  children  referred  to  in  Question  3: 

A.  Are  now  in  high  school? 

How  many?  |  |  |  16-17/ 

B.  And  how  many  are  now  beyond  high  school  (in  college,  university,  or 
vocational,  trade,  or  business  school)? 

How  many?  |  |  |  18-19/ 
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Have  any  of  your  children  dropped  out  of  school  before  graduating  from  high 
school? 

(CIRCLE  OWE) 

Yes    1  —  >  CO  TO  Question  6A  20/ 

No   2  ->  b.CP  TO  Question  7 

A.      If  yes,  How  many?     |  |  |  21-22/ 

What  is  your  sex? 

(CIRCLE  ONE) 

Male    1  23/ 

Female    2 

in  what  ye^    were  you  born? 

Year:  |1|9|JJ 
24-25/ 

A.    Are  you  currently  married? 

(CIRCLE  ONE) 


Yes   1  —  >  GO  TO  Question  8b  26/ 

No    2  —  >  SKIP  TO  Question  9,  next  page 

B.    In  what  year  was       \r  husband/wife  born? 
Year:  |l|9i   I  I 


27-28/ 


3 
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9.    What  is  your  origin  or  descent?  If  more  than  one,  please  circle  below  the  one 
ft      you  consider  the  most  important  part  of  ,our  background. 

(CIRCUS  ONE) 

HISPANIC  OR  SPANISH 

Mexican    01  2^-30/ 

Cuban  •  •  •  •  -   02 

Puerto  Rican   ,   03 

Other  Hispanic  (WRITE  III)      04 

ASIAN  OR  PACIFIC  ISLANDER 

Chinese   05 

Pilipino    06 

Japanese  •••••  ,   07 

Korean  ......   08 

Southeast  Asian 

(Vietnamese,  Laotian,  Cambodian/Kampuchean,  etc.)  .  •  09 

Pacific  Islander    10 

Other  Asian  (WRITE  IN)    11 

NEITHER  HISPANIC  NOR  ASIAN  OR  PACIFIC  ISLANDER    12 
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10.  What  is  your  race? 

*  (CIRCLE  ONE) 

Black    i  31/ 

White    2 

American  Indin  or  Alaskan  Native    3 

Asian  or  Pacific  Islander    4 

Other    5 

11.  Was  the  child's  mother  born  in  the  United  States  (that  is  any  of  the  fifty 
states  or  the  District  of  Columbia),  Puerto  Rico,  or  another  country  or 
area? 


(CIRCLE  ONE) 

She  Was  born  in  the  United  States   1  — >  SKIP  TO  Question  14  32/ 

She  was  born  i    Puerto  Rico   2  — >  GO  TO  Question  12 

She  was  born  in  another  country/area  3  ~>*GO  TO  Question  12 

12.  In  what  year  did  she  come  to  the  United  States  to  stay? 

Year:     |1|9|J  J 
33-34/ 

13.  What  kinc  of  work  did  the  child's  mother  do  most  recently  before  coming  to 
the  United  States? 

OCCUPATION:   35-54/ 

14.  Was  the  child's  father  born  in  the  United  States  (that  is  any  of  the  fifty 
states  or  the  District  of  Columbia),  Puerto  Rico,  or  another  cojntry  or 
area? 

(CIRCLE  ONE) 

He  vas  born  in  the  United  States   1  —  >  SKIP  TO  Question  17,  next  page  55/ 

He  was  bom  in  Puerto  Rico   2  — >  GO  TO  Question  15,  next  page 

He  was  born  in  anothc.  country/area....  3  -->  GO  TO  Question  15,  next  page 
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IS.  In  «aat  year  did  he  come  to  the  United  States  to  stay? 


Year:     |1|9|J  J 
56-57/ 


16.    What  was  the  kind  of  work  the  child's  father  did  most  recently  before  coming 
to  the  United  States? 


17.    Was  your  child  born  i-»  the  United  States  (that  is  any  of  the  fifty  states  or 
the  District  of  Columbia),  Puerto  Rico,  or  another  country  or  area? 


He/she  was  born  in  the  United  States...  1  — >  SKIP  TO  Question  22,  next  page  28/ 


He/she  was  born  in  another  country/area  3  — >  GO  TO  Question  18 

18.  In  what  year  did  your  child  come  to  the  United  States  to  stay? 

Year:  |1|9|JJ 
29-30/ 

19.  Did  your  cnild  attend  school  outside  the  United  States? 

(CIRCLE  ONE) 


OCCUPATION 


BEGIN  DECK  02 
08-27/ 


(CIRCLE  ONE) 


He/she  was  born  in  Puerto  Ric> 


2  — >  GO  TO  Question  18 


Yes 


1  — >  GO  TO  Question  20,  next  page 


31/ 


No 


2         SKIP  TO  Question  22,  next  page 
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What  grade/s  did  your  child  complete  outside  the  United  States' 

(CIRCLE  ALL  TCAT  APPLY) 

a.  Kindergarten   1    32/  f.  Pifth  grade.  t   x  37/ 

b.  First  grad   1    33/  g.  sixth  grad   1  38/ 

c.  Second  grad   1    34/  h.  Seventh  grad   1  39/ 

d.  Third    red   1    35/  i.  Eighth  grade   1  40/ 

e.  Fourth  grade   1    36/  ' 

—  OR  — 

j.  My  child  has  not  completed  any 

grade/s  outside  of  the  United  -States   0  41/ 

What  grade  was  your  child  assigned  to  wher  he/she  started  school  in  the 
United  States? 

(CIRCLE  ONE) 

First  grad  01  Fifth  grad   05  42-43/ 

Second  grade   02  Sixtn    grade   06 

Third  grade  03  Seventh  grade   J7 

Fourth  grade  04  Eighth  grade......  08 

Do  you  speak  a  language  other  than  English? 

(CIRCLE  ONE) 

Yes   1  — >  CO  TO  Question  23,  next  page  W 

1,0  •  2  — >  SKIP  TO  Question  30,  page  13 
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23.    What  language,  other  than  English,  do  you  currently  use  most  often? 

(CIRCLE  ONE) 


Spanish    02 

Italian   03 

Chinese    04 

French    05 

German    06 

Japanese    07 

Korean    08 

Portuguese    09 


Any  Filipino  language  ••••  10 
Other  (WRITE  IM  BELOW)  ...  11 


24*    With  regard  to  the  language  that  you  answered  in  question  23,  how  well  do 
*       you  do  the  following?    (Please  answer  questions  24  and  25  with  regard  :o 
that  language*) 

(CIRCLE  ONE  ON  EACH  LINE) 

How  well  do  you. • • 

Very     Pretty  Not  Very    Not  at 

Well      Well         Well      Well  All  Well 

a*  Understand  that 

language  when  people 

speak  it   1  ....  2  3  ....  4  5 

b.  Speak  that  language.      1  ....  2    3  ....  4    5 

c.  Read  that  language*...  1  ....  2   3  ....  4    5 

d.  Write  that  language...  1  ••••  2    3  ....  4  ,   5 


47/ 
48/ 
49/ 
50/ 
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25.  How  well  do  you  do  the  following? 
II 

(CIRCLE  ONE  Oil  EACH  LIME) 

How  well  do  you...  Very      Pretty  Not  Very      Not  at 

Well      Well       Veil    Well  All  Well 

a.  Understand  spoken 

English   1  ....  2   3  ....  4   5  51/ 

b.  Speak  English   1  ....  2    3  ....  4   5  52/ 

c.  Read  English   1  ....  2    3  ....  4    5  53/ 

d.  Write  Ei-glish   1  2  3   4    5  54/ 

26.  What  language  do  the  people  in  your  home  usually  speak? 
if 

(CIRCLE  ONE) 

English    01  55-56/ 

Spanish    02 

Italian   03 

Chinese    04 

French    05 

German    06 

Japanese  . ,  < .. ..  07 

Korean    08 

Portuguese   09 

Any  Filipino  language   10 

Other:  (WRITE  IN)  11 
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27*  What  language  do  you  usually  speak  to  your  child  in  your  home? 
« 

(CIRCLE  ONE) 


English    01  57-58/ 

Spanish    02 

Italian   03 

Chinese    04 

Prench   «   05 

German    ••••<>   06 

Japanese   07 

Korean   ,   08 

Portuguese   ,   09 

Any  Pilipino  language   10 

Other:  (WRITE  IM)    11 


ERLC 
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28*    What  language  does  your  child  usually  speak  to  you  in  your  home? 
* 

(CIRCLE  ONE) 

English    01  59-60/ 

Spanish    02 

Italian   03 

Chinese   *   04 

French    05 

German    06 

Japanese   07 

Korean   •   08 

Portuguese    09 

Any  Filipino  language...,   10 

Other:  (WRITE  IM)  11 


9 
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29*  What  other  language  is  spoken  in  your  home? 

(CIRCLE  ONE) 

No  other  language  is  spoken  •••»••«   00  61-62/ 

The  other  language  spoken  is: 

English    01 

Spanish   02 

Italian    03 

Chinese   ,  04 

French   ,   05 

German    06 

Japanese   07 

Korean    08 

Portuguese    09 

Any  Filipino  language   •  10 

Other:  (WRITE  IN)  11 
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NOTE:    The  following  question  pertains  to  fundamental  freedoms  of  expression. 
This  question  will  provide  helpful  information  for  the  interpretation  of  survey 
results-    If  you  have  any  reservations  about  answering  this  question,  please 
remember  that  you  may  leave  it  unanswered* 

30*  What  is  your  religious  preference? 

ANSWER  TO  THIf  QUESTION  IS  OPTIONAL 

(CIRCLE  0MB) 

Baptist    01  53-64/ 

Methodist    02 

Lutheran   ■••«.«.,  03 

Presbyterian    04 

Episcopalian    05 

Other  Protestant    06 

Roman  Catholic   07 

Other  Christian,   08 

Jewish    09 

Moslem    10 

Buddhist    11 

Tao   12 

Other  Far  East  religions   13 

Other:  (WRITE  IN)_   14 

None      15 

31.    What  is  /our  current  marital  status?         (CIRCLE  (HIE) 

Single,  never  married    1  55/ 

Married   fc   2 

Separated    3 

Divorced    4 

Widowed    5 

13 
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The  next  series  of  questions  are  about  your  educational  and  work  experience  and 
those  cf  your  spouse  or  your  child's  current  guardian,  if  your  child  lives  with 
his/her  guardian. 

32.  Wh*t  is  the  highest  level  of  education  you  have  completed? 

(CIRCLE  ONR) 


Less  than  high  school  diploma 
GED   


High  school  graduation 


(Less  than  one  year 
One  to  two  years  • . 
Two  years  or  more  . 


Aess  than  two  years 
of  college   


Two  or  more 
years  of  college 


College  program 


Finished  a  two-year 
ogram   


Finished  a  four  or 
five-year  program  . 


01 
02 
03 
04 
05 
06 

07 

08 

09 

10 


Master's  degree  or 

equivalent    U 


Ph.D.,  M.D.,  or 
other  advanced 
^degree   


12 
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33.    What  is  the  highest  level  of  education  your  spouse  or  y*ur  child's 
current  guardian  has  completed? 

(CIRCLE  OMB) 

Less  than  high  school  diploma    01 

GED   02 

High  school  graduation    03 


cher 


Vocational,  trade, 
or  business  schools 
after  High  School 


^Less  than  one  year 
One  to  two  years 
^Two  years  or  more  . 


Less  than  two  years 
of  college   


Two  or  more 
years  of  college 


College  program  ^ 


Finished  a  two-year 
program  


Finished  a  four  or 
five-year  program  • 


04 
05 
06 

07 

OS 

09 

10 


Master's  decree  or 
equivalent    11 

I  Ph.D.,  M.D. ,  or 
I  other  advanced 

\iegree    12 


68-69/ 


Child  has  no  other  guardian. 


99 
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34*    During  the  past  week,  were  you  working  full-time  (35  hours  or  more)  or 
«  part-time? 

(CIRCLE  ONE) 

Yes,  working  full-time    1  — >  SXIP  TO  Question  35,  noxt  pags  70/ 

Yes,  working  part-time    2  — >  SKIP  TO  Question  35,  next  page 

No,  I  have  a  job  but  was  not  at  work 
because  of  t  jmparary  illness, 

vacation,  or  strike    3  — >  SKIP  TO  Question  35,  next  page 

No   4  — >  GO  TO  Qu~   cion  34A 

A.  IP  *C:    What  were  you  doing?  (CIRCLE  ONE) 
ft 

Unemployed,  looking  for  work  -.<•   1  71/ 

Unemployed,  not  looking  for  work   2 

Retired   <.  3 

In  school    4 

Keeping  house  (full-time)  •    5 

renewing  else  (EXPLAIN)   6 

B.  IF  NO:    Have  you  ever  l*cl&  a  regular  job  (including  self-employment)? 
ii 

(CIRCLE  ONE) 

Yes    1  — >  GO  TO  Question  35,  next  page  72/ 

Ko    2  — >  SKIP  ^0  Question  36,  page  19 
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35.    nlease  describe  your  present  or  most  recent  job. 

A.  Are  you  self-employed  or  do  you  work  for  someone  else? 

(CIRCLE  OWE) 

Self-employed    1  08/ 

Working  for  someone  else   ? 

B.  What  kind  of  work  do/did  you  normally  do?    That  is,  what  is/was  your  lob 
*  called? 

OCCUPAT ION :  

C.  What  do/did  you  actually  do  in  that  job?    What  are/were  some  of  your  main 
duties? 


D.  Describe  the  place  that  you  wor*  or  worked  for. 

INDUSTRY  (e.j.,  manufacturer  ov  fast-food  restaurant^: 


E.  What  do/did  they  ,*ke/do? 


ERIC 
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P.      Which  of  ch€  categories  below  com*  closest  to  describing  this  job? 

(CIRCLE  ONE) 

CLERICAL  such  as  bank  teller,  bookkeeper, 

secretary,  typist,  mail  carrier,  ticket  agent    01 

CRAPTSPERSON  such  as  baker,  automobile  mechanic,  machinist, 

painter,  plumber,  telephone  installer,  carpenter   , ...  02 

PARMER,  PARM  HAN  ACER   03 

HOMEMAJCER  OR  HOUfrWIPE  ONLY    04 

LABORER  such  as  construction  worker,  car  washer, 

sanitary  vorker,  farm  laborer   ,  Q5 

MANAGER,  ADMINISTRATOR  such  as  sales  manager,  olfice 
manager,  school  administrator,  buyer,  restaurant 

manager,  government  official   c>  Q6 

MILITARY  such  as  career  officer,  enlisted  man  or 

woman  in  the  Armed  To'-cfcS  ,  %  07 

OPERATIVE  such  as  meat  cutter,  assembler,  machine 

operator,  welder;  taxicab,  but,  or  truck  driver    08 

PROFESSIONAL  such  as  accountant,  artist,  registered  nurse, 

engineer,  librarian,  writer,  social  worker,  actor,  actress, 

athlete,  politician,  but  not  including  school  teacher  09 

PROFESSIONAL  such  as  clergyman,  dentist,  physician, 

lawyer,  scientist,  college  teacher   \q 

PROPRIETOR  OR  OWNER  such  as  owner  of  a  small  business, 

contractor,  restaurant  owner    n 

PROTECTIVE  SERVICE  such  as  detective,  police  officer  or 

guard,  sheriff,  fire  fighter   ,  ,   12 

SA'-ES  such  &s  salesperson,  advertising  or  insurance 

agent,  real  estate  broker   ,   13 

SCHOOL  TEACHER  such  as  elementary  o-  secondary    14 

SERVICE  such  as  barber,  beautician,  practical 

nurse,  private  household  worker,  janitor,  wait*.   P   15 

TECHNICAL  such  as  draftsman,  medical  or  dental 

technician,  computer  programmer    1$ 

Never  worked   17 

Don1 1  know   18 

18 
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36.    During  the  past  week,  was  your  spouse  or  your  child's  current  guardian  (the 
one  your  child  lives  with)  working  £  ll-t?me  (35  hours  a  week  or  more)  or 
part-time? 

(CIRCLE  ONE) 

Yes,  working  full-time    1  —  >  SKIP  TO  Question  37,  next  page  11/ 

Yes,  working  part-time    2  -->  SKIP  TO  Question  37,  next  page 

No,  he/she  has  a  job,  but  was  not  at  work 
because  of  temporary  illness,  vacation 

or  strike    3  —  >  SKrp  TO  Question  37,  next  page 


No 


4  — >  GO  TO  Question  36A 


A.  IP  NO:    What  was  he/she  doing?  (CIRCLE  ONE) 

Unemployed,  looking  for  work  ,   1  12/ 

Unemployed,  not  looking  for  work  2 

Retired    3 

In  school    4 

Keeping  house  (full-time)    5 

Something  else  (EXPLAIN)  6 

B.  IP  NO:    Has  he/she  ever  held  a  regular  job  (including  self-employment)? 

(CIRCLE  ONE) 

Yes   ,  1  ~>  CO  TO  Question  37,  next  page  13/ 

No  ....»  2  -->  SKIP  TO  Question  38,  page  22 
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37.    Please  describe  your  spouse's  present  o.  most  recent  job. 

A,  Is  he/she  self-employed  or  does  he/she  work  for  someone  else? 

(CIRCLE  ONE) 

Self-employed    1  14/ 

W^ks  for  someone  else   2 

B.  Uhat  kind  of  work  does/did  he/she  normally  do?    What  is/was  his/her  job 
called? 

Occupation:   

C.  What  does/did  he/she  actually  do  in  that  job?    What  are/were  some  of 
his/her  main  duties? 


D.  Describe  the  place  that  he/she  does  or  did  work  for, 
INDUSTRY  (e.g.,  manufacturer,  fast-food  restaurant): 


£.  What  do/did  they  make/do? 
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F.      Which  of  the  categories  below  come  closest  to  describing  this  iot? 

(CIRCLE  ONE) 


CLERICAL  such  as  bank  teller,  bookkeeper, 

secretary,  typist,  mail  carrier,  ticket  igent    01 

15-16/ 

CRAFTS PERSON  such  as  baker,  automobile  mechanic,  machinist, 

painter,  plumber,  telephone  installer,  carpenter    02 

FARMER,  FARM  MANAGER   03 

HOMEMAKER  OR  HOUSEWIFE  ONLY   04 

LABORER  such  as  construction  worke-,  car  washer, 

sanitary  worker,  farm  laborer    05 

AANACER,  ADMINISTRATOR  such  as  sales  manager,  office 
manager,  school  administrator,  buyer,  rejtaurant 

manager,  government  official    06 

MILITARY  such  as  career  officer,  enlisted  man  or 

woman  in  the  Armed  Forces   07 

OPERATIVE  such  as  meat  cutter,  assembler,  machine 

operator,  welder;  taxicab,  bus,  or  truck  driver    08 

PROFESSIONAL  such  as  accountant,  artist,  registered  nurse, 

engineer,  librarian,  writer,  social  worker,  actor,  actress, 

athlete,  politician,  but  not  including  school  teacher   09 

PROFESSIONAL  such  as  c'ergyman,  d?,tist,  physician, 

lawyer,  scientist,  college  teacher    10 

PROPRIETOR  OR  OWNER  such  as  owner  of  a  imall  business, 

contractor,  restaurant  owner    11 

PROTECTIVE  SERVICE  such  as  detective,  police  officer  or 

guard,  sheriff,  fire  fighter    12 

SALES  such  as  salesperson,  advertising  or  insurance 

agent,  real  estate  broker  „  ,   13 

SCHOOL  TEACHER  such  as  elementary  or  secondary    14 

SERVICE  such  as  barber,  beautician,  practical 

mrse,  private  household  worker,  janitor,  waiter   15 

TFCHNICAL  such  as  draftsman,  medical  or  dental 

tt     .lician,  computer  programmer   16 

Never  worked    17 

Don't  know  ,   18 
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38.  What  was  the  highest  level  of  education  completed  by  your  father? 

(CIRCLE  ONE) 

Less  than  h.gh  school  diploma    01 


CED 


02 


Hi„h  school  graduation    03 

 04 

  05 

  06 


(Less  than  ore  year 
One  to  two  /ears  . . 
Two  years  or  more  . 


Voca 
a 


College  program  <C 


Less  Chan  two  years 
of  college   


Two  or  more 
years  of  college 


Pinished  a  two-year 
program   


07 


08 


09 


Pinished  a  four  or 
fiv^-year  program   10 

Master's  degree  or 

equivalent    n 

Ph.D. ,  M.D. ,  or 
other  advanced 
^degree    \2 


17-18/ 
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39*    How  many  times  has  your  child  changed  school  since  he/she  entered  first 
■       grade?  (DO  NOT  count  changes  that  occurred  as  a  result  of  school  policy,  for 
example,  because  of  promotion  to  another  grede  or  level.    That  is,  do  not 
count  changes  that  occurred  in  the  normal  progression  from  one  school  to 
another  in  the  same  school  district*) 

(CIRCLE  ONE) 


None   0  19/ 

One    1 

Two    2 

Three    3 

Pour   4 

Five  or  more   5 


40.    How  long  has  your  child  been  at  his/her  current  school? 

(CIRCLE  ONE) 

This  is  his/her  first  year.c  1  20/ 


This  is  his/her  second  year   2 

This  is  his/her  third  yeac   3 

This  is  his/her  fourth  year  4 

This  is  his/her  fifth  year  or  more    5 
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41*  What  is  your  name,  address  ant  telephone  number? 
ft 

NAME: 


ADDRESS: 

ADDRESS 
CONTINUED: 


Ust  21-40/ 


Number 


First  41-52/ 


Middle  53-62/ 


BEGIN 
DECK  04 


Street  08-27/ 


BEGItt  DECK  u5        APC-  No-  28-47/ 


City 


48-67/ 


State        08-22/  Code  23—27 / 


If  you  don't  have  a  telephone,  Check  this  box  I  I 

TELEPHONE:    (  ) 


Area  Code  Number 

29-31/ 


32-38/ 


28/ 


42.    What  is  the  name,  address  and  telephone  number  of  a  close  relative  who  does 
*       not  live  with  you?    Choose  someone  who  is  likely  to  know  how  to  locate  you 
if  you  move. 

BEGIN  DECK  06 

NAME: 


Last  39-58/ 


First  59-70/ 


Middle  08-17/ 


ADDRESS: 

ADDRESS 
CONTINUED: 


Number 


Street  18-37/ 


BEGIri  DECK  07         APC*  No*38-57  / 


City 


58-77/ 


State        03-22/  Zlp  Code  23-27/ 


TELEPHONE:  (If  knowr)      (  ) 


Area  Code  Number 

28-30/ 

What  is  this  person's  relation  to  you? 


31-37/ 


38-49/ 


2A 
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43.    What  is  the  name,  address,  and  telephone  number  of  a  cldse  family  friend  who 
*       does  not  live  with  you?    Choose  someone  who  is  likely  to  know  how  to  locate 
you  if  you  move. 


NAME: 


BEGIN  DECK  08 


Last 


50-69/ 


First 


08-19/ 


Hide le 


20-29/ 


ADDRESS: 

ADDRESS 
CONTINUED: 


City 


Number 


08-27/ 


State  28-42/ 


Street  30-49/ 


Apt.  No. 


50-69/ 


BEGIN 
DECK  OS 


Zip  Code  43-47/ 


TELEPHONE:     (If  known) 


(  ) 
Area  Code 
48-50/ 


Number 


51-57/ 


44.  Where  do  you  expect  your  child  to  attend  high  school? 


NAME  OF  SCHOOL: 


ADDRESS  OP  SCHOOL: 


BEGIN 
DECK  1( 


08-37/ 


Street 


City 


TELEPHONE  (If  known):  (  ) 

Area  Code 
08-10/ 


38-57/  State  58-72/ Zip  Code  77/ 


Number 


11-17/ 


BEGIN 
DECK  11 


ERLC 
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1. 
» 


PART- 2  YOUR  CHILD'S  FUTURE 
The  following  questions  are  about  your  child's  plans  for  the  future. 
How  far  in  school  do  you  exptct  your  child  to  go? 

(CIRCLE  ONE) 

Less  than  '  Igh  school  diploma    01 

GED  02 

High  school  graduation    03 

 OA 

 ^.  Ob 

 06 


{Less  than  one  year 
One  to  two  years  . , 
Jwo  years  or  more  • 


'Less  than  two  years 
of  college   07 


Two  or  wore 
years  of  college 


08 


College  program 


09 


Finish  a  two-year 
I  program   

Finish  a  four  or 

five-year  program    10 

Master1 s  degree  or 
equivalent   ,   n 

Ph.D. ,  M.D. ,  or 
other  advanced 
y^degree    12 


18-19/ 
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2.  Other  than  your  child  him/herself,  who  do  you  think  will  influence  his/her 
plans  for  high  school? 

(CIRCLE  ONE) 

Mostly  you   1  20/ 

Mostly  your  spouse  (or  your  child's  current 
guardian)   2 

You  and  your  spouse  (or  your  child's  current 
guardian)  about  equally  •  -   3 

Neither  you  nor  your  spouse  (or  child's  current 
guardian)  4 

3.  Who  do  you  think  is  the  most  influential  in  deciding  a  student's  plans  Tor 
high  school? 

(CIRCLE  ONE) 

The  student  him/herself    1  21/ 

Teachers   •   2 

Counselors   3 

Parents/Guardians  4 

Other  (WRITE  IM   )..  5 


ERLC 
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4.    Do  you  feel  that  your  child  has  any  of  the  following  problems? 
ft 

(CIRCLE  OMB  ON  BACH  LINE) 
Yes  No 

a*  Visual  handicap  (net  corrected  by  glasses)  . ...  1    2  22/ 

b.  Hearing  problem  *   1    2  23/ 

c.  Deafness    1    2  24/ 

d.  Speech  problem  ,   1 

e.  Orthopedic  problem 
(for  example,  club  foot,  absence  of  arm 

or  leg.  cerebral  palsy,  amputation,  polio)  . 1 

f.  Specific  learning  problem 
(for  example,  imperfect  ability  to  listen 

think,  speak,  read,  write,  spell,  or  do 
mathematical  calculations)    1 

g.  Other  health  problem  (Write  in)  ]  1 


2 
2 

2 
2 


25/ 


26/ 


27/ 
28/ 
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PART-3  YOUR  CHILD'S  SCHOOL  LIFE 

1.  Did  your  child  ever  attend  any  oi  the  following  structured  programs  outside 
your  home? 

(CIRCLE  ONE  ON  BACH  LINE) 

Don't 
Yes         No  know 

a.  Day  care  or  child  care    1    2    8  29/ 

b.  Nursery  or  pre-school    1    2    8  30/ 

c.  Head  Start    1   2  8  31/ 

d.  Kindergarten    1  2  £  32/ 

e.  Extended  Day    1  2  8  33/ 

2.  Has  your  child  ever  received  special  services  for  any  or  all  of  the  following 
*  conditions? 

(CIRCLE  ONE  ON  EACH  LINE) 

Don 1 1 

Yet*  No  know 

a.  Visual  handicap  (not  corrected  by  glasses)    1    2    8  34/ 

b.  Hearing  problem   1    2    8  35/ 

c.  Deafness   1    2    8  36/ 

d.  Speech  problem    ,  1    2    8  37/ 

e.  Orthopedic  problem 

(for  example,  club  foot,  absence  of  arm 

or  leg,  cerebral  palsy,  amputation,  polio)    1    2    8  38/ 

f.  Specific  learning  problem 

(for  example,  imperfect  ability  to  listen, 
think,  speak,  read,  write,  spell,  or  do 

mathematical  calculations)    1    2    8  39/ 

g.  Other  health  problem  (Write  in)  1   2   8 
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3*      Is  your  child  considered  to  have  a  behavior  problem  at  school? 
ft 

(CIRCLE  0MB) 

Yes    1  41/ 

No   2 

Don't  imow  8 

4*      Was  your  child  ever  considered  to  have  a  behavior  problem  at  school? 

(CIRCLE  ONE) 

Yes    1  42/ 

No    2 

Don't  know  3 

5*      Was  your  child  ever  accelerated  (skipped  a  grade)  in  school  because  , you  or 
the  child's  other  parent  or  guardian  requested  it? 

(CIRCLE  ONE) 

Yes   1  43/ 

No    2 

6*      Was  your  child  ever  accelerated  (skipped  a  grade)  in  school  b    ause  the 
school  recommended  it? 

(CIRCLE  ONE) 

Yes    1  44/ 

No  >  2 

7*      If  your  answer  to  Questions  5  and/or  6  was  Yes,  what  grade(s^  did  he/she 
skip? 

(CIRCLE  ALL  THAT  APPLY) 

a.  Kindergarten   1      45/  e.  Fourth  *   1  49/ 

b.  First   1       46/  £.  Fifth   1  50/ 

c.  Second   1       47/  g*  Sixth   1  51/ 

d.  Third   1       48/  h    Seventh   1  52/ 

30 
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8.      Was  your  child  ever  held  back  in  school  because  you  or  the  child's  other 
parent  or  guardian  requested  it? 


Yes. 

No.. 


(CIRCLE  ONE) 
....  1 
 2 


53/ 


9.      Was  your  child  ever  held  back  in  school  because  the  school  recommended  it? 

(CIRCLE  ONE) 

Yes   1  54/ 

No  2 


10.    If  your  answer  to  Questions  8  and/or  9  was  Yes,  what  grade(s)  did  he/she 
repeat? 


a.  Kindergarten, 

b.  First  

c.  Second  

d.  Third  

e.  Fourth  

f.  Fifth  

g.  Sixth  

h.  Seventh  

i.  Eighth  


(CIRCLE  ALL  THAT  APPLY) 

55/ 


11.    Did  someone  read  to  your  child  be 
him/herself ; 


56/ 
57/ 
58/ 
59/ 
60/ 
61/ 
62/ 
63/ 


ore  hi/she  was  able  to  r^.ad  to 
(CIRCLE  ONE) 

Yes    1 

No    2 

Can't  -.emember  or  don't  know  ....  8 


64, 
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12.  Is  your  child  currently  enrolled  in  an/  of  the  following  special 
*      prog  rams /services? 

(CIRCLE  ONE  ON  EACH  LINE) 

Don't 

Yes  No  know 

a.  Bilingual  or  bicultural  education   1   2   8  65/ 

b.  English  as  a  second  language   ,  •  1    2    8  66/ 

c.  Special  Services  tor  orthopedically 

handicapped    1    2    8  67/ 

d.  Special  education  services 

for  slow  learners    1    2    8  68/ 


13.  Is  your  child  currently  enrolled  in  a  gifted  or  talented  program? 

(CIRCLE  ONE) 

Yes    1  — >  GO  TO  Question  14,  next  page  69/ 

No    2  —  >  SKIP  TO  Section  A,  Question  1 

Don't  know  8  — >  SKIP  TO  Section  4,  Question  1 
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14,    How  important  to  you  are  each  of  the  following  possible  benefits  of  a  gifted 
and  talented  program: 

(CIRCLE  ONE  Oil  EACH  LIVE) 


Very 

important 


Somewhat 
important 


Not  very 
important 


Not  at  all 
important 


Child  may 
complete 

school  faster    1 


70/ 


b.  Child  may  gain 
deeper 

understanding  of 
school  subjects  « 


71/ 


c.  Child  has 

opportunity  to 
associate  with 
other  high- 
ability  children 


72/ 


d.  Child  has 
greater 
intellectual 
challenge  and 
stimulus   1 


73/ 


e.  Child  has 
opportunities 
for  development 
of  musical 
or  artistic 
values  < 


74/ 
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PART-4  YOUR  CHILD'S  FAMILY  LIFE 
About  how  many  books  did  you  read  during  the  past  year? 

(CIRCLE  ONE) 

Hone   •„   1 

One  or  two   2 

Between  three  and  ten  ...  3 
More  than  ten    4 

Do  you  have  a  computer  used  for  educational  purposes  in  your  home? 

(CIRCLE  ONE) 

Yes    1 

No   2 


08/ 


09/ 


Does  your  child  attend  classes  outside  of  his/her  regular  school  to  study 
any  of  the  following? 

(CIRCLE  ONE  ON  EACL  iJNE) 
Yes  No 

  2 

  2 

 2 


a  •  Art 

b.  Music  ... 

c.  Dance 
d •  Language 
e.  Religion 


f .  The  history  and  culture  of  /our 
ancestors   


g.  Other  (WRITE  IN 


10/ 
11/ 
12/ 
13/ 
14/ 

15/ 
16/ 
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Do  you  have  rules  for  your  child  about  any  of  the  following 
television-related  activities? 

(CIRCLE  ONE  ON  BACH  LIME) 
Yes  No 

a.  What  programs  he/she  may  watch    1    2  17/ 

b.  How  early  or  late  he/she  may  watch 

television    1  2  18/ 

c.  How  many  hours  he/she  may  watch 

television  overall    1    2  19/ 

d.  How  many  hours  he/she  may  watch 

television  on  school  days    1  ......  2  20/ 

Do  you  enforce  rules  for  your  child  about  any  of  the  following  activities? 

(CIRCLE  ONE  OH  EACH  LINE) 
Yes  %  No 

a.  The  grades  he/she  must  maintain  in 

school   ,   i  2  21/ 

b.  Doing  homework    1    2 

c.  Doing  household  chores    1    2 

how  satisfied  are  you  with  the  education  your  child  nas  received  up  to  now? 

(CIRCLE  ONE) 

Very  satisfied    1  22/ 

Somewhat  satisfied    2 

Not  satisfied  at  all   3 
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7.  -     Parents  differ  in  how  much  they  talk  to  their  children  about  what  :hey  do  in 

school.    How  much  do  you  talk  with  your  child  about  his/her  experiences  in 
school? 

(CIRCLE  ONE) 

Not  at  all    1  23/ 

Somewhat   2 

A  great  deal   3 

8.  How  much  do  you  talk  with  your  child  about  his/her  report  card? 

(CIRCLE  ONE) 

Not  at  all   1  24/ 

Somewhat   2 

A  great  deal   3 

9.  Parents  differ  in  how  much  they  talk  to  tl  lir  children  about   .heir  plans  for 
high  school.    How  much  do  you  talk  with  your  child  about  his  her  plans  for 
high  school? 

(CIRCLE  ONE) 

Not  at  all   o  1  25/ 

Somewhat    2 

A  great  deal  .  3 

10.  How  much  do  you  talk  with  your  child  about  his/her  plans  for  after  high 
school? 

(CIRCLE  ONE) 

Not  at  all    1  26/ 

Somewhat   2 

A  great  deal   3 


36 


ERLC 


DECK  12 


11.  How  often  do  you  or  your  spouse  help  your  child  with  his/her  homework? 

(CIRCLE  OMB) 

Seldom  or  never   1  27 

Once  or  twice  a  month.  2 
Once  or  twice  a  week  •  3 
Almost  every  day    4 

12.  Are  any  of  the  following  people  usually  at  home  when  your  child  returns  home 
*      from  school? 

(CIRCLE  ONE  ON  EACH  LINE) 


Yes 

No 

a. 

28/ 
29/ 

b. 

c. 

30/ 
31/ 

d. 

e. 

32/ 

f. 

33/ 
34/ 
35/ 

g* 

Older  brother  or  sister  .... 

h. 

Younger  brother  or  sister 

...  1 

i . 

36/ 

13.  How  much  time  does  your  child  spend  by  him/herself  each  day  after  school, 
*      without  adult  supervision? 

(CIRCLE  ONE) 

None    0  37/ 

Less  than  1  hour    1 

More  than  1,  but  less  than  2  hours    2 

2  hours  or  more,  but  less  than  3  hours  .  3 

More  than  3  hours   4 
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14.    Do  you  or  your  child  take  part  in  any  of  the  following  activities? 

Circle  TWO  on  each  line,  one 
for  you  and  one  for  your  child. 

A.  YOU  3.  YOUR  CHILD 

Don't 


Yes       No  Yes         No  Know 

,38/  ,  39/ 


a.  Borrow  books  from  the 
public  library   . .  1  .... 

b.  Attend  concerts  or  other 

musical  events  ••••••••••  1  ••••  2  •  •  •  •  •  •  •  1  ••••  2  ••••  8 

c •  Go  to  art  museums   1  ••••  2  •         •  •  •  •  1  ••••  2  ••••  8 

d.  Go  to  science  museums  1  , ...  2  2.. ..8 
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PART-5  YOUR  CONTACT  WITH  YOUR  CHILD'S  SCHOOL 

1.      How  many  timet  during  the  past  year  has  your  child's  school  contacted  you 
about  each  of  tha  following? 

(CIRCLE  ONE  Oil  EACH  LINE) 

Once  or     Three  or  More  than 

None  twice      four  times       four  times 

a.  Your  child's 
academic  work  or 

choice  of  courses   0    1    2    3  46/ 

b.  Your  child's  behavior  ,0    1   2    3  47/ 

c.  Doing  something  for 
the  school  (like 

fundraising)    0    1    2   3  48/ 


49/ 
50/ 


d.  Something  adminis- 
trative, like 

asking  your  address  ...  0    1   2   3 

e.  Doing  volunteer  work       0    1   „  2    3 

2.      How  many  times  during  the  past  year  have  you  contacted  your  child's  school 
about  each  of  the  following? 

(CIRCLE  ONE  ON  EACH  LINE) 

Once  or        Three  or         More  than 
None  twice  four  times      four  times 

a.  Your  child's 
academic  work  or 

choice  of  courses  0    1    2   3  51/ 

b.  Your  child's  behavior..  0    1    2    3  52/ 

c.  Doing  something  for 
the  school  (like 

fundraising)    0    1    2    3  53/ 

d.  Something  administra- 
tive, like  providing 

your  address   0    1    2    3  54/ 

e.  Doing  volunteer  work  #.  0    1    2    3  55/ 
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3.  Do  you  do  any  of  the  following  at  or  with  your  child's  school? 

(CIRCLE  ONE  ON  EACH  LINE) 
Yes  No 

a.  Belong  to  a  parent-teacher 

organization   •  1    2  56/ 

b.  Attend  meetings  of  a  parent- 
teacher  organization    1    2  57/ 

c.  Take  part  in  the  activities 
of  a  parent-teacher 

organization    1    2  58/ 

d.  Act  as  a  volunteer  at 

the  school    1   2  59/ 

4.  Have  you  been  consulted  by  your  child's  school  about  any  of  the  following? 

(CIRCLE  ONE  ON  EACH  LINE) 
Yes  No 

a.  Your  child's  course 

selection  for  this  year    1    2  60/ 

b.  Your  child's  course 

selection  for  high  school    1    2  61/ 

c.  Special  placemert  decision 

regarding  your  child    1    2  62/ 

5.  Have  you  attended  any  parent-teacher  conferences  for  your  child  this  year? 

(CIRCLE  ONE) 

Yes    1  63/ 

No    2 

6*      Have  you  received  any  information  from  the  school  about  vocational  or 
pre-vocat ional  courses  available  to  your  child? 

(CIRCLE  ONE) 

Yes    1  64/ 

No    2 
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PABT-6  YGJR  OPINIONS  ABOUT  vOUR  CHILD'S  SCHOOL 

Indicate  the  extent  of  your  agreement  or  disagreement  with  each  of  the 
following  statements  about  the  school  your  child  attends. 


Disagree 
Strongly 

The  school  places 

a  high  priority 

on  learning   1  . , 


b.  The  homework 
assigned 

is  worthwhile    1 

c.  Ny  child 

is  challenged  at 

school    1 

d.  Ny  child 

is  working  hard 

at  school    1 

e.  Ny  child 

enjoys  school    1 

f«  The  standards  set 
by  the  school  are 
realistic    1 

g.  The  school  is 
preparing  students 
adequately  for 

high  school    1 

h.  The  school  is 
preparing  studencs 
adequately  for 

college    1 

i.  The  school  is  a 

safe  place    1 

j.  Parents  have  ai 
adequate  voice  in 
setting  school 
policy    1 


(CIRCLE  ONE  ON  EACH  LINE) 

Agree 

Disagree  Agree  Strongly 


2 


3 


65/ 
66/ 
67/ 

68/ 
69/ 

70/ 
71/ 


72/ 
73/ 

74/ 


41 


•ERLC 


■  <  5S8 


*E*TN  DECK  13 


PART- 7  FINANCIAL  INFORMATION  AND  EDUCATIONAL  COaTS 

This  next  series  of  questions  is  about  the  present  situation  of  you  and  your 
family.    Wa  need  this  information  in  order  to  compare  your  answers  with  those  of 
other  people  who  take  part  in  this  survey*    This  information  will  be  kept 
confidential  and  it  will  never  be  used  witu  your  name* 

For  the  questions  in  this  section,  we  do  not  need  to  know  the  exact  amount 
of  money  but  only  ranges  of  income  and  assets,    For  each  type  of  income,  choose 
the  letter  code  from  the  following  list  that  comes  closest  to  the  amount  of 
income  your  family  received  from  that  source.    IF  YOU  AO*        SU^Z  nbOUT  THE 
AMOUNT  FOR  SOME  TYPES  OF  INCOME,  PLEASE  ESTIMATE. 


Lets  Chan 

$  20,000 
$  25,000 

$  1,000  - 

$  2,999    B 

$  35,000 

$  3,000  - 

$  4,999  ....  C 

$  50,000 

S  5,000  - 

$  7,499    D 

$  75,00v 

$  "•  500  - 

$  9,999    E 

$100,000 

$10,000  - 

$14,999  ....  P 

$200,000 

$15,000  - 

$19,999    C 

1.  About 

your  total  family 

income  in  1986. 

USE  LETTER 

FROM  CHART  ABOVF 


A.  How  much  did  your  family  receive  from 
wages,  salary,  commissions,  or  tips 
from  all  jobs,  before  deductions  for 

taxes  or  anything  else?   

B.  How  much  income  did  your  family  receive 
from  work  you  did  on  your  own  or  in  your  own 
business  or  farm?    (Net  income,  that  is, 
income  after  expenses*)   


i 


08/ 


09/ 


2.      Is  there  one  parent  or  are  there  tvo   >arents  in  your  household? 

(CIRCLE  ONE) 

One  pare  t    1  10/ 

Two  parent    1 
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3.      About  your  FAMILY'S  debts  and  savings,  but  not  including  those  of  you 
CHILDREN: 

A.       Using  the  above  list,  choose  the  letter 

code  that  represents  how  much  yen   

currently  owe  | 
(Include  mortgage  and  consumer  debt)   |  


B.      Uai:Mt  the  above  list,  use  the  letter  code 
that  v« presents  how  much  money  you  have 
in  saving.)  now.    (DO  NOT  COUNT  IRAs  but 
include  sivings  and  investments)   


C.      Using  the  above  list,  choose  the  letter 
code  that  represents  how  much  you  had  in 
savings  at  this  time  last  year. 
(DO  irtOT  COUNT  IRAs  but  include  savings 
and  investments)   


Do  you  currently  have  any  of  the  following  education- I  expenses  for  ai 
your  children? 

(CIRCLE  ONE  ON  EACH  LINE) 
Yes  No 

a.  Private  or  religious  school  tuition 

and  associated  expenses    1   ,  2 

b.  College  tuition  and  associated  expenses   1   2 

c.  Tutoring    1    2 


If  your  answer  to  a,  b  &  c  is  "NO"  in  every  case,  SKIP  TO  Q.  6. 

5.  USE  LETTER  CODE  FROM  CHART  BELOW 

A.        Using  the  chart  below,  enter  the  letter  that 
reprssents  the  total  amount  you  havd  >penc  or 
will  spend  86-87  school  year  for  all  of  the 
educational  expenses  you  circled  in  Question  3.. 


.  None   

Less  than  $100 
$  .100  -  $  499 
$  500  -  $  999 
$1,000  -  $1,999 
$2,000  -  $2,999 
$3,000  -  $3,999 


0 
A 
B 
C 
D 
E 
F 


$  4,000  -  $  4,999 
$  5,000  -  $  5,999 
$  6,000  -  $  7,999 
$  8,000  -  $  9,999 
$  10,000  -  $14,999 
$  15,000  -  $19,999 
$  20,000  or  more.. 

43 
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B.      Which  of  the  following  sources  of  money  did  you  or  will  you  use  to  cover 
educational  expenses  (of  the  type  listed  in  question  4  above)? 

(CIRCLE  ALL  THAT  APPLY) 

a*  Your  (or  your  spouse's)  current  earnings   1  18/ 

b.  Your  (or  your  spouse's)  savings  or  sale  of  assets   1  19/ 

c.  Second  mortgage   1  2°/ 

d    Yrur  (or  your  spouse's)  borrowing  (personal  loan,  etc.)   1  21/ 

e.  Alimony  or  child  support..   1  22/ 

f.  Your  child's  earnings  or  savings   1  23/ 

g.  A  trust  fund   1  24/ 

h.  Contributions  from  relatives   1  25/ 

i.  Scholarships  or  grants   1  26/ 

j.  State  or  federal  loans   1  27/ 

k.  Social  Security  or  Veteran's  Administration  benefits   1  28/ 

1.  Other  (WRITE  m)_   1  29/ 
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6*    Have  you,  your  spouse,  or  your  child's  custodial  parent  or  Legal  guardian 
*     done  anything  specific  in  order  to  have  some  money  for  your  child's  education 
after  high  school? 

(CIRCLE  ONE) 

Yes    1  — >  CO  TO  Question  6A,  62,  6C  and  60  30/ 

No  2  — >  SKIP  TO  Question  7,  page  47 

A.    IF  YES:    Hav<j  you  .  «  . 

(CIRCLE  ONE  ON  EACH  LINE) 


Yes  No 

a.  Started  a  savings  account    1    2  31/ 

b.  Bought  an  insurance  policy   1    2  32/ 

c.  Bought  U.S.  Savings  Bonds    1    2  33/ 

d.  Made  investments  in  stocks  or  real  estate  1    2  34/ 

e.  Set  up  a  trust  fund  .   . ...  1    2  35/ 

f •  Started  working  or  taken  an  additional  job  •  1   2  35/ 

g.  Something  else  (DESCRIBE)^  

 •  1    2  37/ 


B.  About  how  much  money  have  you  set  aside  for  your  child's  future 
*    educational  needs? 

(WRITE  AMOUNT  HERE    $   and  CIRCLE  ONE  Below) 


None    0  38/ 

Less  than  $1,000    1 

$  1.000  to  $  3,000  ...  2 
$  3,001  to  $  6,000  ...  3 
$  6,001  to  $10,000  ...  4 
$10,001  to  $15,000  ...  5 
More  than  $15,000  ....  6 


A5 
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C.  About  how  much  money  do  you  expect  Co  have  sec  aside  for  your  child's 
•    fuCure  educational,  needs  by  Che  cime  s/he  finishes  high  school? 


(WRITE  AMOUNT  HERE    $   and  CIRCLE  ONE  Below) 

None   0 

Less  Chan  $1,000    1 

$  1,000  co  $  3,000  ...  2 

$  3,001  co  $  6,000  ...  3 

$  6,001  co  $10,000  ...  4 

$10,001  co  $15,000  ...  5 

More  Chan  $15,000  ....  6 

D.  Do  you  expect  chis  amounc  co  cover  che  cocal  cose  of  his/her  educacion? 

(CIRCLE  ONE) 

Yes    1 

No   2 

If  NO,  where  will  che  additional  money  come  from? 

(DESCRIBE. )  

41-42/ 


46 
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7.  The  following  statements  are  about  financial  aid  for  education  beyond  high 
school.  Indicate  whether  each  statement  is  true  or  false  for  your  family 9 
no  matter  what  plans  your  child  has. 

(CIRCLE  ONE  OH  EACH  LINE) 

We  haven't 
thought  about 
True         False  this  yet 

a.  My  child  will  be  able  to  earn 
all  the  money  he/she  will  need 

for  schooling  beyond  high  school   1    2    3  43/ 

b.  We  can  pay  for  our  child's 
further  education  without 

getting  any  outside  assistance   1  2    3  44/ 

c.  The  family, is  not  willing  to  - 

go  into  debt  for  schooling    l  2    3  45/ 

d«  The  family  income  is  too  high 
to  qualify  for  a  loan  or 

scholarship  .   1    2    3  46/ 

e.  My  child's  grades  are 
probably  not  high  enough  to 
qualify  for  a  loan  or 

scholarship    1  2    3  47/ 

f.  My  child's  test  scores 

are  probably  not  good  enough 
to  qualify  for  a  loan  or 

scholarship    1  2    3  48/ 

g«  Too  much  paper  work  is  required  in 

order  to  apply  for  financial  aid   1  2    3  49/ 

h.  I  have  not  been  able  to  get  much 
information  on  how  and  where  to 

apply  for  financial  aid    1    2    3  50/ 

i.  I  do  not  see  any  way  of  getting 
enough  money  to  allow  my 

child  to  get  more  education   1    2    3  51/ 

j.  Other  relatives  will  help  to 
pay  my  child's 

educational  expenses    1   2    3  52/ 
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OMB  No.  18SO-0953 
Expire*  June  30,  1987 


TEACHER  QUESTIONNAIRE 
NELS:  88 

NATIONAL  EDUCATION  LONGITUDINAL 
STUDY  OF  1988 
FIELD  TEST 

Prepared  for 

U.S.  Department  of  Education 
Center  for  Education  Statistics 


Prepared  by: 
NORC, 

A  Social  Science  Research  Center 
University  of  Chicago 


As  a  matter  of  policy,  the  Center  for  Education  Statistics  is  concerned  with  protecting  the  privacy  of 
individuate  who  participate  in  voluntary  surveys.  We  want  to  let  you  know  that 

1.  Section  406  of  the  General  Education  Provisions  Act  (20-USC  1221e-l)  aMows  us  to  ask  you  the 
questions  in  this  questionnaire. 

2.  You  may  skip  auy  questions  yon  do  not  wish  to  answer. 

3.  We  are  asking  you  these  questions  in  order  to  gather  information  about  what  happens  to  students  as 
they  move  into  high  school  and  make  decisions  about  postsecondary  education  and  work. 

4.  Your  responses  will  be  merged  with  those  of  other  respondents,  and  the  answers  you  give  will  never  be 
identified  as  yours. 
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This  questionnaire  is  part  of  a  large  national  study  of  eighth  grade  students  and 
their  parents,  schools  and  teachers.  Your  school  has  agreed  to  participate  in  this  study  and  has 
allowed  us  to  select  a  random  sample  of  eighth  graders,  who  will  be  the  focus  of  several  data 
collection  activities  in  the  coming  weeks.  A  list  of  these  sampled  students  should  be  included  in 
the  same  packet  that  contains  this  questionnaire.  (If  the  list  is  missing,  please  report  the 
problem  to  the  study  coordinator  at  your  school  --the  person  who  distributed  this  questionnaire 
to  you.)  You  have  been  identified  as  a  current  teacher  of  one  or  more  of  the  sampled  eighth 
graders,  and  in  that  capacity,  we  are  seeking  information  from  you  to  supplement  other  study 
data  about  these  students. 


The  questionnaire  has  three  very  different  sections: 


■  Part  I  (pp.  1-2)  asks  you  to  indicate  which  of  the  sampled  students  you  have 
had  in  class  this  year,  and  for  each  of  those,  to  evaluate  whether  or  not  the 
student  has  had  various  school-related  problems  and  handicaps.  Individual 
students  are  referred  to  by  "Student  No.,"  as  shown  in  the  attached  list  of 
sampled  students. 

■  Part  II  (pp.  3*12)  asks  a  series  of  questions  about  specific,  designated  classes. 
The  particular  class  or  classes  for  which  information  is  being  requested  is 
indicated  on  the  label  that  is  affixed  to  the  cover  page  of  this  questionnaire. 
As  you  will  see.  Part  C  contains  room  for  responses  to  a  maximum  of  five 
classes.  You  may  not  need  all  five  response  columns,  however  use  only  as 
many  columns  as  are  needed  to  respond  separately  for  each  of  the  classes 
listed  on  the  label.  In  the  unlikely  event  that  your  label  lists  more  than  five 
classes,  your  packet  should  contain  a  "Continuation  Questionnaire"  (Part  II 
only)  for  use  in  answering  questions  about  classes  numbered  6  and  above. 

■  Part  in  (pp.  13*21)  requests  some  general  background  information  about 
yourself  and  your  school. 

Please  answer  directly  on  the  questionnaire  by  circling  the  appropriate  number  or 
by  writing  your  response  in  the  space  provided. 


We  realize  that  you  are  very  busy;  however,  we  ask  that  you  complete  the 
questionnaire  and  return  it  to  your  school's  study  coordinator  within  the  next  two  weeks  (or 
sooner,  if  asked  by  the  coordinator).  To  protect  the  confidentiality  of  your  responses,  we 
suggest  that  you  return  the  completed  questionnaire  to  its  original  envelope  and  then  seal  the 
envelope  before  turning  it  in. 


Thank  you  very  much  for  your  help. 


PART  I.  STUDENT  INFORMATION 


Pi.ua  umr  tb«  aumtions  in  thU  aaction  by  eirelin«  tha  appropriats  rmponsa  for  tech  of  the  studants  in  tha  attachad  Hit:  1= 
2»N?  SSon'l iKnSw  (OKI .  NOTE:  PImm fuirar  Qumc&n  1  for  tach  studtnt  listtd.  Qumtions  WO  apply  only  to  studants 
for  whom  Quaation  1 »  YES.  


ANSWER  FOR 
EACH  STUDENT 

IP  YES  TO  QUESTION  I:  PLEASE  INDICATE  WHETHER  THIS  ST1JDI 

SNT: 

Studio*  1 
Number 

(tltWB 

ftttachtd 

m) 

L.  Hm  this  ttudtnt 
bftfto  rtfulariy 
uticn*d  to  onm 
or  own  of  your 

«ln^nn  Mn^m 

S«pt«mb«r  1986? 

2.  Consistently 
performs 

tMlOW 

ability? 

8.  Rarely 

COOpUtM 

homework? 

4.  It 

iroqUw*cijr 
abw.nt? 

5.  la 
tardy? 

6.  Is 
consistently 
inattentive 
in  dam? 

Ym  No 

Ym    No  DK 

Ym   No  DK 

Ym    No  j  DK 

Ym    No  j  DK 

Yss    No  DK 

01 

1       2  • 

1      2  8 

1      2  8 

1      2  8 

I      2  8 

02 

l  , 

1       2  S 

1       2  8 

1       2  8 

1       2  8 

1      2  8 

OS 

1  j 

1       2  • 

1       2  8 

1       2  8 

1       2  8 

I       2  2 

04 

1  j 

1       2  S 

1       2  8 

1       2  8 

1       2  8 

I       2  8 

OS 

1  , 

1       2  • 

1       2  8 

1       2  8 

1       2  8 

I       2  8 

06 

l  j 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

07 

!  j 

1       2  • 

1       2  8 

i       2  8 

1       2  8 

I       2  8 

OS 

t  j 

1       2  • 

1       2  8 

1       2  8 

1       2  8 

I       2  8 

00 

1  j 

1       2  • 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

10 

j  j 

1       2  • 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

11 

l  . 

1       2  • 

1       2  8 

I       2  8 

1       2  8 

1       2  i 

1) 

j  j 

1       2  • 

1       2  8 

1       2  8 

1       2  8 

I       2  8 

IS 

j  j 

1       2  • 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

t  j 

1       2  • 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

IS 

j  j 

1       2  S 

1       2  8 

1       2  8 

1       2  . 

1       2  8 

IS 

l  j 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

IT 

1  j 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

I       2  8 

IS 

j  j 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

19 

1  , 

1       2  8 

i       2  8 

1       2  8 

1       2  8 

I       2  8 

20 

t  j 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

I       2  8 

21 

l  , 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

I       2  8 

22 

t  j 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

23 

x  j 

1       2  8 

1       2  8 

1       2  8 

1       2  8 

I       2  8 

24 

1  , 

I       2  8 

I       2  8 

I       2  8 

I       2  8 

1       2  8 

2S 

!  , 

1       2  8 

26 

X  2 

1       2  8 

2T 

28 

29 

SO 

SI. 

32 
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PARTI.  (CONTINUED) 


4fc  it/font 

Number 
(from 

attached 
list) 

7.  Ia 
exceptionally 
passive  or 
withdrawn? 

8.  It 
frequently 
disruptive? 

9.  Hat  over  fallen 
behind  In  school 
work  bocamo  of 
e  health 
problem? 

10.  Currently  haa  a 

physical  or 
emotional  nanai* 
cap  that  it 
affectin*;  his  or 
her  school  work? 

11.  Is  a 
Lanfuaft 

Minority  (LM) 
student? 

IS    \u  %.  Limited 

mm*    mm  •  Mtaatatw 

English 
Proficiency 
(LEP)  studsnt? 

Yea   No  DK 

Yes   No  DK 

IM    NO  DK 

Tee    no  uk 

Yes    No  DK 

Yet    No  DK 

01 

1      2  » 

1      2  8 

1 

 \  1  

1       2  8 

1       2  8 

US 

— i  -  

— i — ! — ? — 

— i  

L  ?   8 

1       2  8 

OS 

— i — I — !  

1      2  8 

— i — I — - — 

1       2       8  _ 

1      2  8 

04 

— 1  ! — 

 i  1  

1      2  8 

1       2  8 

00 

 1  1  



1      2  8 

1       2  8 

05 

— i — ? — ?  

 1  1  ?  



1      2  8 

1       2  8 

07 

1      2  8 

— l- — - — 8 

01 

— i — ? — *  



— i — I — - — 

1       2  8 

09 

1     2  » 

1  8 

1      2  8 

1 — " — " — ■ — 

1       2  8 

1 A 

10 

1  8 

— -  - — 

1       J  8 

1       J  8 

11 

 1  1  »  

1 — " — " — - — I 

1      2  8 

— - —  

— i — I — - — 

1       2  8 

1       J  8 

12 

1      2  8 

— i  -  

— i — I — - — 

r   1      2  $ 

1       2  8 

•a 
13 

— i — I — !  

 1  1  

pJ — ? — ! — 

M.         l                  j  8 

14 

 i — I — !  

— i — I — ! — 

— - —  

1      2  8 

12  8, 

mm 

li 

1 

— -  

1      2  8 

1       2  8 

10 

 1 — l — »  

12  8 

1       2  8 

17 

1       2  8 

1       2  8 

la 

 1 — l — »  

1       2  8 

1       2  8 

1 A 

19 

i     a  8 

1      2  a 

— i — I — I — 

1       2  8 

1       2  8 

21 

 1 — l — »  

— 1 — I — • — 

1       2  8 

1       2  8 

22 

— i — I — I  

— 1 — ? — - — 

— i — I — L_ 

1       2  8 

1       2  8 

23  . 

 \ — I — ?  

1       2  8 

1       2  8 

24 

1       2  8 

1       2  8 

25 

— " — \ — I  

— 1 — \ — \ — 

8 

1       2  8 

1       2  8 

20 

1       2  8 

V       2  8 

2T 

4          •  0 

28 

1       2  8 

20 

1       2  8 

SO 

31 

1       2  8 

32 

1       2  8 

0 
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PART  II.  CLASS  INFORMATION 


Please  iniww  the  following  questions  for  t&ch  class  designated  on  the  fact  sheet  of  the  questionnaire. 


CLASS  #1 

CLASS  #2 

1.      What  is  the  litis  of  this  class?  (e.g., 
Algebra,  English  1,  Earth  Scitncs, 

2.      Which  of  tht  foUowinf  bast  describe* 
ths  ability  makeup  of  ths  8th  graders  in 
this  class  compared  with  ths  average 
8th  grade  student  in  this  school?   

This  class  consists  of: 

(CIRCLE  ONE) 

Primarily  higher  ability  itudsnts    I 

Primarily  average  ability  students    2 

Primarily  lower  ability  itudsnts   3 

Students  of  widely  differing  ability    4 

This  class  consists  of: 

(CIRCLE  ONE) 
Primarily  hichsr  ability  itudanti  l 
Primarily  average  ability  itudsnts  2 

Primarily  lower  ability  itudanti    3 

Students  of  widely  differing  ability  4 

3.      How  many  students  are  enrolled  i* 

class?   

1     1     1  students 

1     1     1  studsnts 

4.      Do  you  teach  any  part  of  this  class  in  a 

(CIRCLE  ONE) 

(CIRCLE  ONE) 
No                        2  -  Skip  to  Que  it  ion  6 

9.      What  language  is  that? 

Name  of  language 

Name  of  language 

o.      How  many  Limited  English  Proficiency 
(LEP)  students  are  assigned  to  this 
class? 

No.  of  LEP 

tudents  in  this  class  I  |  | 

No.  of  LEP 

students  in  this  class  I  |  | 

7.     How  many  minutes  of  homework  do  you 

1     !     1  Minutes 

1  |  |  Minutes 

H           Raw        an  H/\  vaii  M*\  a*i*W  *st  kU.  , 

°        nww  oitvn  ho  you  ao  •sen  oi  mu 

following  with  homework  assignments? 

a.  Keep  records  of  who  turned  in  ths 

b.  Return  assignments  with  grades  or 

c.  Discuss  the  assignment  in  class  

^wUtCLJS  One*  ON  EACH  LINE) 
All  ths      Most  of     Some  of 
time       the  time     the  time  Never 

a.  1              2             3  4 

b.  1              2              3  4 

c.  1              2              3  4 

(CIRCLE  ONE  ON  EACH  LINE) 
All  the      Most  of     Some  of 
time       the  time     the  time  Nsvsr 

a.  1             2             3  4 

b.  1              2              3  4 

c.  1               2              3  4 

9.      Which  textbook  (or  commercially 
prepared  workbook)  constitutes  ths 
primary  source  that  you  use  in  this 
class? 

TITLE 
AUTHOR(S) 
PUBLISHER 
PUBLICATION  DATE/EDITION 

/ 

/ 

er|c  3  600 


CLASS  #3 

CLASS  #4 

CLASS  #3 

ThU  daaa  tonaiiti  oft 

(circle  ONE) 

Primarily  Wajhar  ibUitr  rtudanU   1 

Primarily  avaraf*  ability  itudanU   2 

Primarily  lornr  ability  atudanU   3 

StudanU  of  widafty  diflarinc  ability   4 

Thia  '-laaa  conaiaU  of: 

(CIRCLE  ONE) 

Primarily  hifhar  abiUty  itudanU    1 

Primarily  avarafa  ability  itudanU   * 

Primarily  lowar  abiUty  itudanU   3 

Studanta  of  widary  diflarinc  abUity   4 

Thir  daaa  conaiaU  of: 

(CIRCLE  ONE) 

Primarily  bighar  ability  itudanta    1 

Primarily  avaraca  ability  itudanta    2 

ay  a  annnaamaaj^T  • w      ^^aa                ^  j 

StudaaU  of  widaly  diffarinc  abiUty    a 

I    |    |  atudanU 

itudanU 

1     1    1  itudanta 

(CIRCLE  ONE) 

Yaa  M           1  -  Anawar  Quaation  S 

No                    3  -  SWP  to  Quaation  6 

(CIRCLE  ONE) 

Ya»                     1  -  Anawar  Quaatioa  1 

No                       *  -  SUp  to  Quaatioo  6 

(CIRCLE  ONE) 

Yaa                    1  -  Anawar  Quaation  3 

No                      3  -  Skip  to  Quaation  6 

NatM  of  l*Tf"H* 

Mum  of  lanauaaa 

No.  of  UP 

studanu  in  thia  daaa  1    1  1 

No.  of  LEP 

itudanU  in  .bt»  daaa  1     1  1 

Ma  rJ  T  F.P 
HO*  Of  Lbr 

itudanU  in  thia  daaa  1     1  1 

|  |    1  Minutaa 

1  1     1  Minutaa 

1     1     1  Minutaa 

(CIECLB  ONE  ON  EACH  LINE) 
All  tha      Moat  of     Soma  of 
tirna       tba  tima    thatima  Navar 

a.  1             3             3  4 

b.  1              3              S  4 
•              •              a  a 

c.  1             *              3  4 

(CIRCLE  ONE  ON  EACH  LINE) 
All  tha      Moat  of     Soma  of 
tima       thatima     thatima  Navar 

a.  1             3             3  4 

b.  1              3             3  4 
i              a             *  4 

C.       1                   *                   3  * 

(CIRCLE  ONE  ON  EACH  LINE) 
All  tba      Moat  oi     soma  01 
tima       tha  tima     tha  tima  Navar 

a.  1             1             S  * 

b.  1              2             S  < 
e.     1              2             S  * 

/ 

/ 

4 


10.  Approximately  wnal  percentage  thU 
textbook/workbook  will  you  "eovtr*  in 
this  course  

11.  Please  grvs  /our  opinion  about  each  of 
the  following  stsAemeote  related  to  this 
textbook/workbook*  This  textbook: 

ft.  is  aS  a  reading  lovsi  which  Is  too 
difficult  for  most  of  oqr 
students   

b.  holps  develop  problem-solving 
tUlk  .   „  

e.  explains  concepts  dearly   

d.  provides  food  suggssttons  for 


CLASS  #1 
(CIRCLE  ONI) 


0- 

50-  60- 

70- 

•0- 

90- 

0- 

50- 

60- 

70- 

SO- 

90- 

19ft  69% 

roft 

99ft  100ft 

49ft 

69ft 

69ft 

TPft 

SO* 

99ft  100ft 

1 

3  3 

4 

8 

6  7 

1 

2 

S 

4 

6 

6  7 

CLASS  #2 
(CIRCLE  ONE) 


(CIRCLE  ONE  ON  EACH  LINE) 
Strongly  No  Strongly 

Aero*  Afros    Opinion  Dissert*  Disserts 


(CIRCLE  ONE  ON  EACH  LINE) 
Strongly  No  Strongly 

Agrss  Agrss    Opinion  Dissgrss  Disagree 


12.    Indicate  Sim  persons  or  groups  who 
holpsd  determine  that  you  would  uso 
this  particular  text  book /workbook  in 
this  class. 


(CIRCLE  ALL  THAT  APPLY) 

s,  I  did   1 

b.  The  principal    1 

c.  A  group  of  toachsrs  from 

this  school   1 

d.  A  district-wide  textbook  adoption 
committee   I 

w^»     e^L  w^wit^*  ^^wsal^  fcwflCfcas^OOk  ewClOp^iOwa1 

committss  *   1 

f  .    Department  Hsad   1 

g.  Other   1 

(CIRCLE  ONE) 

Totally  unprepared   1 

Somewhat  prepared   2 

Adequately  prepared   3 

Well  prepared    4 

Very  well  prepared   5 


(CIRCLE  ALL  THAT  APPLY) 

a.  Idid   l 

b.  The  principal    1 

c.  A  *roup  of  teachers  from 

Uusschool    1 

d.  A  district-wide  textbook  adoption 
committee   1 

e.  A  state- wide  textbook  adoption 


f.  Department  Head 

g.  Other  


IS.    How  adequately  prepared  do  you  feel 
to  teach  the  subject  matter  covered  in 
this  courseT 


Totally  unprepared  ... 
Somewhat  prepared  ... 
Adequately  prepared 

Well  prepared   

Very  well  prepared  ... 


(CIRCLE  nNE) 


14.    How  many  hours  per  week  does  this 
class  mast  regularly  (exclude  lab 
periods)? 


I  |  Hours 


I  |  Hours 


IS.  Indicate  about  how  much  time  you 
spend  each  weak  doing  each  of  the 
following  with  this  class. 

a.  providing  instruction  to  the  class  as 
a  whole  

b.  providing  instruction  to  small 
groups  of  students  

c.  providing  instruction  to  individual 
students   

d.  maintaining  order/ disciplining 
students   

e.  administering  tests  or  quiasss  

f .  performing  routine  administrative 
tasks  (s*g.,  taking  attendance, 
making  snnouncsmsnts,  etc.)   

g.  conducting  lab  periods   


(CIRCLE  ONE  ON  EACH  LINE) 


<1 

1 

2 

S 

4 

5+ 

hr. 

hr. 

hr. 

hr. 

hr. 

hr. 

S 

4 

6 

6 

7 

S 

4 

S 

6 

7 

s 

4 

1 

6 

7 

s 

4 

1 

6 

7 

s 

4 

S 

6 

7 

s 

4 

5 

6 

7 

s 

4 

$ 

6 

7 

(CIRCLE  ONE  ON  EACH  LINE) 
<1 

None  hr. 


1 

2 

S 

4 

5+ 

hr. 

hr. 

hr. 

hr. 

hr. 

S 

4 

5 

6 

7 

S 

4 

5 

6 

7 

s 

4 

5 

6 

7 

s 

4 

5 

6 

7 

s 

4 

5 

6 

7 

s 

4 

5 

6 

7 

s 

4 

5 

6 

7 

o 
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CLASS  #3 

(CIRCLE  ONI) 
0-    SO*   60-    70-    SO-  90- 
49%  89%  69ft  79%  89%  99%  im% 


(CIRCLE  ONE  ON  EACH  LINE) 
Strongly  No  Strongly 

Ag.ee  Agree    Opinion  Diaacret  Pieacree 


CLASS  #4 

(CIRCLE  ONE) 
0-     50-    60-    70-    80-  90- 
49%  59%  69%  79%  89%  99%  100% 


6 


(CIRCLE  ONE  ON  EACH  LINE) 
Strongly  No  Strongly 

Agree  Agree    Opinion  DUegree  Disagree 


CLASS  #5 

(CIRCLE  ONE) 
0-     SO-    60-    70-    80-  90- 
49%  59%  69%  79%  89%  99%  100% 


6 


(CIRCLE  ONE  ON  EACH  LINE) 
Strongly  No  Strongly 

Agrto  Agrto    Opinion  Ditagrto  Disagree 


(CIRCLE  ALL  THAT  APPLY) 

a.  I  did   1 

b.  Tht  principal    * 

e.  A  group  of  t— chaw  from 

thia  tehooi    1 

d.  A  district -widt  textbook  adoption 

eanuaittao   1 

t.   A  staie*wide  Uxtbook  adoption 

committee  -   I 

f.  Department  Road  -~   I 

g.  Othor   I 

(CIRCLE  ONE) 

Totally  unprtparad    I 

Somewhat  prtpartd   2 

Adequately  prtpartd   3 

WtU  prtpartd    4 

Vtry  wail  prtpartd   5 


.  (CIRCLE  ALL  THAT  APPLY) 

a.  I  did   1 

b.  Tht  principal    1 

c  A  group  of  taachars  from 

thia  school   I 

d.  A  dlftrict-widt  textbook  adoption 
eommitttt   I 

e.  A  state- wide  taxtbook  adoption 
eommitttt   I 

f.  Department  Htad   I 

g.  Othor   1 

(CIRCLE  ONE) 

Totally  unprtparad   1 

Somovhat  prtpartd   2 

Adequately  prtpartd   3 

Wtll  prtpartd   4 

Vtry  wtU  prepare    5 


(CIRCLE  ALL  THAT  APPLY) 

a.  I  did   1 

b.  Tht  principal    1 

e.  A  group  of  ttachtn  from 

this  school    I 

d.  A  district-wide  textbook  adoption 
eommitttt   1 

e.  A  state- wide  taxtbook  adoption 
committee   I 

f.  Department  Htad   1 

g.  Other   1 


(CIRCLE  ONE) 

Totally  unprepared   1 

Somewhat  prepared   2 

Adequately  prepared   3 

Well  prepared    •* 

Very  well  prtpartd   5 


I  |  Hourt 


|  1  Hours 


(CIRCLE  ONE  ON  EACH  LJV"  * 


(CIRCLE  ONE  ON  EACH  LINE) 


<1 

* 

2 

3 

4 

5+ 

<1 

1 

2 

3 

4 

5+ 

hr. 

hr. 

hr. 

hr. 

hr. 

hr. 

Nont  hr. 

hr. 

hr. 

hr. 

hr. 

hr. 

3 

4 

6 

6 

7 

I  3 

3 

i 

5 

6 

7 

3 

4 

6 

6 

7 

3 

4 

5 

6 

7 

3 

4 

6 

6 

7 

3 

4 

5 

6 

7 

3 

4 

6 

6 

7 

3 

4 

5 

6 

7 

3 

4 

5 

6 

7 

3 

4 

5 

6 

7 

3 

4 

6 

6 

7 

3 

4 

5 

6 

7 

3 

4 

6 

6 

7 

3 

4 

5 

6 

7 

J  H^urs 


(CIRCLE  ONE  ON  EACH  LINE) 


<1 

1 

2 

3 

4 

5  + 

hr. 

hr. 

hr. 

hr. 

hr 

hr 

3 

4 

5 

6 

3 

4 

5 

6 

7 

3 

4 

5 

6 

7 

3 

4 

5 

6 

7 

3 

4 

5 

6 

7 

3 

4 

5 

6 

7 

3 

4 

5 

6 

7 

o 
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THE  REMAINDER  OF  PART  TWO  CONSISTS  OF  QUESTIONS  THAT  APPLY  TO  SPECIFIC  SUBJECTS.  FOR  EACH  CLASS 
DESIGNATED  ON  THE  FACE  SHEET,  PLEASE  ANSWER  ONLY  THE  QUESTIONS  THAT  APPLY  TO  THE  SUBJECT  BEING 
TAUGHT  IN  THAT  CLA*S:  ENGLISH  (QUESTION  16),  MATHEMATICS  (QUESTIONS  17-10),  SOCIAL  STUDIES  (QUESTION  20), 
OR  SCIEUCE  (QUESTIONS  tt-W). 


ANSWER  QUESTION  16  FOR  ENGLISH 
CLASSES  ONLY. 


CLASS  #J 


16.    Indicate  how  much  cniphaais  is  given  in 
this  class  to  th«  following  by  checking 
whether  each  is  a  Major  Topic,  Minor 
Topic,  Review  Topic,  or  Not  Covered 
aft  AIL 

a.  Grammar  

b.  Literature   

c.  Writinc  skills  

d.  Study  skills  ... 

e.  Spelling  


(CIRCLE  ONE  ON  EACH  LINE) 
Major       Minor       Review  Not 
Topic        Topic        Topic  Covered 


a. 

b. 
c. 
d. 


ANSWER  QUESTIONS  17-19  FOR 
MATHEMATICS  CLASSES  ONLY 


17.    Indicate  how  much  emphasis  is  given  in 
this  dee*  to  the  following  by  checking 
whether  each  is  a  M;  jor  Topic,  Minor 
Topic,  Revkw  Topic,  or  Not  Covered  at 

All. 

a.  Common  fractions   

b.  Decimal  fractions  

c.  Ratio  and  proportion  

d.  Percent   

e.  Measurement   

f.  Geometry  

C.  Algebra  (formulas  and  equations)  .. 

h.  Integers  

i.  Probability  and  statistics  

j.    Problem  solving  


(CIRCLE  ONE  ON  EACH  LINE) 
Major       Minor      Review  Not 
Topic       Topic       Topic  Covered 


a. 

b. 
c. 
d. 

e. 

f. 

«• 

h. 

i. 


(CIRCLE  ONE  ON  EACH  LINE) 


Major 
Topic 


Minor 
Topic 


Review 

Topic 

3 
3 
3 
3 

3 

3 
3 
3 

3 
3 


Not 
Covered 


18.    Do  your  students  have  access  to  pocket 
or  hand  held  calculators  owned  by  the 
school  for  use  in  this  class?   


(CIRCLE  ONE) 
Yes  No 
1  2 


(CIRCLE  ONE) 
Yes  No 
1  2 


Ifr.    On  the  average,  how  often  do  your 

students  use  calculators  (the  school's  or 
their  own)  in  this  class?  


Everyday    1 

Several  times  a  week    2 

About  once  a  week   3 

Hardly  ever  or  novar    4 


Every  day    l 

Several  times  a  week   

About  once  a  week   

Hardly  ever  or  never   


7  €04 


CLASS  #3 


CLASS  #4 


CLASS  #5 


(CIRCLE  ONE  ON  EACH  LINE) 
Major       Minor      Review  Not 
Topic        Topic        Topic  Covered 


(CIRCLE  ONE  nN  EACH  LINE) 
Major       Minor       Review  Not 
Topic        Topic        Topic  Covered 


b. 
c. 
d. 
e. 


(CIRCLE  ONE  ON  EACH  LINE) 
Mftjor     Minor    Review  Not 
Topic      Topic      Topic  Covered 


ft.  1  2  3 

b.  1  2  3 

c.  1  2  3 

d.  1  2  3 

e.  1  2  3 


(CIRCLE  ONE  ON  EACH  LINE) 


(CIRCLE  ONE  ON  EACH  LINE) 


Major 

Topic 


Minor 
Topic 


ft. 

b. 
c. 
d. 

e. 

f. 

I'- 
ll. 


Review 
Topic 

3 
3 
3 
3 

3 
3 
3 
3 

3 
3 


Not 
Covered 


Mftjor 
Topic 


Minor 
Topic 


Review 

Topic 


Not 
Covered 


(CIRCLE  ONE  ON  EACH  LINE) 
Mftjor     Minor    Review  Not 
Topic      Topic      Topic  Covered 


ft. 

b. 
c. 
d. 

e. 

f. 
f 

h. 

i. 
J- 


3 

4 

ft. 

3 

4 

b. 

3 

4 

c. 

3 

4 

d. 

3 

4 

e. 

3 

4 

f. 

3 

4 

I'- 

3 

4 

ll. 

2 
2 
2 
2 

2 
2 
2 


3 
3 
3 
3 

3 

3 
3 
3 

3 
3 


4 
4 
4 

4 

4 
4 
4 
4 

4 

4 


(CIRCLE  ONE) 
Yet  No 
1  2 


(CIRCLE  ONE) 
Yet  No 
1  2 


(CIRCLE  ONE) 
Yet  No 
I  2 


Every  day    1 

Several  timet  ft  week    2 

About  once  ft  week   3 

Herdly  ever  or  never   4 


Every  dey    I 

Several  timet  ft  week    2 

About  once  ft  week    3 

Hftrdly  ever  or  never    4 


Every  dftv   

Several  timet  ft  week 
About  once  ft  week  . 
Hftrdly  ever  or  never 


9 
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ANSWER  QUESTION  20  FOR  SOCIAL 
STUDIES  CLASSES  ONLY. 


CLASS  #1 


CLASS  #2 


70.    Indicate  bow  much  «mphsoii  is  ghrta  in 
this  dees  to  the  foUowinf  by  checking 
whether  eech  is  ft  Mftjor  Topic,  Minor 
Took,  Review  Took,  or  Not  Covered 
•ft  AIL 

a.  State  hJetory  

b.  United  States  or  American 
history  

c.  World  or  Western  history  

d.  ClTka/foronuiMnl 

c.  Geography  

f.   Curront  events  

* 

b. 


(CIRCLE  ONE  ON  EACH  LINE) 
Minor      Review  Not 


Topic 

Topic 

Topic 

Covered 

Topic 

Topic 

Topic 

Covered 

a,  1 

2 

3 

4 

ft. 

1 

2 

3 

4 

b.  1 

2 

3 

4 

b. 

1 

2 

3 

4 

c.  1 

2 

3 

4 

c. 

1 

2 

3 

4 

d.  1 

2 

3 

4 

d. 

1 

2 

3 

4 

t.  1 

2 

3 

4 

e. 

1 

2 

3 

4 

f.  1 

2 

3 

4 

r. 

1 

2 

3 

4 

*  I 

2 

3 

4 

c 

1 

2 

3 

4 

b.  1 

2 

3 

4 

h. 

1 

2 

3 

4 

(CIRCLE  ONE  ON  EACH  LINE) 
Mftjor  Minor 


Review  Not 


ANSWER  QUESTIONS  21-26  FOR 
SCIENCE  CLASSES  ONLY  . 


21.    Indicate  bow  much  emphasis  ift  five*  in 
this  class  to  too  following  by  chocking 
whether  eech  is  ft  Mftjor  Topic,  Minor 
Took,  Roviow  Topic  cr  Not  Covered 
ftt  AIL 

ft.  Plftatft  

b.  Animals  

c.  Humaa  biology   

d.  Genetics  

Personal  health  

f.    Eftrtb  science  or  geology   

f .  Wofttbor   

h.  Artronomy  or  space   

i.  Electricity  or  tnagnetisnt  

j.  Mechanic*   

k.  Htftt  

I.  Optics   

m.  Cboraiotry  

n.  Atomic  theory  

o.  Environmental  tcience  

p.  Oceanography  

q.  Science  end  society  


(CIRCLE  ONE  ON  EACH  LINE) 
Mftjor       Minor      Roviow  Not 
Topic       Topic  Took 


ft. 

b. 
c. 
d. 

e. 

t 
c 

h. 

i. 

j- 
k. 
I. 

m. 
n. 
o. 
P- 

q. 


2 
2 
2 
2 

2 
2 
2 
2 

2 
2 
2 
2 

2 
2 
2 
2 
2 


3 
3 
3 
3 

3 
3 
3 
3 

3 
3 
3 
3 

3 
3 
3 
3 
3 


Covered 

4 
4 
4 
4 

4 
4 
4 
4 

4 
4 

\ 
4 

4 
4 
4 
4 
4 


(CIRCLE  ONE  ON  EACH  LINE) 
Mnjor       Minor      Review  Not 
Took       Took       Took  Covered 


ft. 

b. 
c. 
d. 

e. 

r. 
c 

h. 

L 

j- 
k. 
I. 

m. 
n. 
o. 
P. 


2 
2 
2 
2 

3 
2 
2 
2 

2 
2 

2 
2 

2 
2 
2 
2 
2 


4 
4 
4 
4 

4 
4 
4 
4 

4 
4 
4 
4 

4 
4 
4 
4 
4 


22.    How  often  do  you  demonstrate  ft 
science  experiment  in  dees? 


(CIRCLE  ONE) 

Almost  every  day  

About  once  ft  week   2 

About  once  ft  month    5 

Less  then  once  ft  month   

Never  


(CIRCLE  ONE 


Almost  every  dfty   

About  once  ft  week  

About  once  ft  month   

Less  then  once  ft  month 
Never  


O  - 
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CLASS  #3 

CLASS  #4 

CLASS  #5 

(CIRCLE  ONE  ON  EACH  UNE) 

(CIRCLE  ONE  ON  EACH  UNE) 

(CIRCLE  ONE  ON  EACH  LINE) 

Mftjor 

Minor  * 

RiYitw  Not 

Major 

Minor 

Review  Not 

Mftjor 

Minor 

Review 

Not 

Topic 

Topic 

Topic  CovAfwi 

Topic 

Topic 

Topic  Covered 

Topic 

Topic 

Topic 

Covered 

ft.  1 

2 

3  4 

ft.  1 

2 

3  4 

o. 

1 

2 

3 

4 

b.  1 

2 

3  4 

b.  1 

2 

3  4 

b. 

1 

2 

3 

4 

e.  1 

2 

3  4 

c.  1 

2 

3  4 

c. 

1 

2 

3 

4 

d.  1 

2 

3  4 

d.  1 

2 

3  4 

d. 

1 

2 

3 

4 

t.  1 

2 

3  4 

t.  1 

2 

3  4 

e. 

1 

2 

3 

4 

f.  1 

2 

3  4 

f.  1 

2 

3  4 

f. 

1 

2 

3 

4 

C  1 

2 

3  4 

(.  1 

2 

3  4 

f. 

1 

2 

3 

4 

h.  1 

3  4 

h.  1 

2 

3  4 

h. 

1 

2 

3 

4 

(CIRCLE  ONE  ON  EACH  UNE) 

(CIRCLE  ONE  ON  EACH  UNE) 

(CIRCLE  ONE  ON  EACH  LINE) 

Major 

Minor 

Review  Not 

Mftjor 

Minor 

Review  Not 

Mftjor 

Minor 

Review 

Not 

Topie 

Topic 

Topic  Covered 

Topic 

Topic 

Topic  Covered 

Topic 

Topic 

Topic 

Covered 

*.  1 

2 

3  4 

ft.  1 

3  4 

ft. 

1 

4 

b.  1 

2 

3  4 

b.  I 

3  4 

b. 

1 

3 

4 

e.  1 

2 

e.  I 

3  4 

c. 

1 

3 

4 

d.  1 

2 

d.  I 

3            4  ' 

d. 

1 

3 

4 

•.  1 

2 

e.  1 

3  4 

e. 

1 

3 

4 

f.  1 

2 

f.  1 

3  4 

f. 

1 

3 

4 

%  1 

2 

I-  * 

3  4 

f. 

1 

3 

4 

h.  1 

2 

h.  1 

3  4 

h. 

1 

3 

4 

i.  1 

2 

i.  I 

3  4 

i. 

1 

3 

4 

J-  I 

2 

j-  I 

3  4 

J- 

1 

3 

4 

k.  I 

2 

k.  I 

3  4 

k. 

1 

3 

4 

1.  1 

? 

!.  I 

3  4 

1. 

1 

3 

4 

m.  I 

2 

m.  I 

3  4 

m 

.  1 

3 

n.  1 

2 

n.  1 

3  4 

n. 

1 

3 

o.  1 

2 

o.  1 

3  4 

0. 

1 

3 

P  I 

3 

P-  1 

3  4 

P- 

1 

3 

q.  i 

2 

q-  i 

3  4 

q. 

1 

3 

(CIRCLE  ONE) 

(CIRCLE  ONE) 

(CIRCLE  0 

  1 

Almrvafc  avafY 

  2 

About  once  ft  week  

  2 

About  once*  ft  month  ... 

About  once  ft  month  ... 

  3 

Less  than  onct  ft  month 

Lcsc  thftn  once  ft  month 

  4 

Lmi  thin  ones  e  month 

ft 

N*v*»     

  S 
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39.    Row  often  do  itudeoU  conduct  science 
experiments  In  this  el  am? 

CLASS  #1 

CLASS  #2 

f  CIRCLE  ONE) 

(CIRCLE  one; 

24.    Indicate  whether  or  not  you  novo  teews 
to  teioaco  laboratory  facilities  for  your 
laaehtog  in  kh&M  dees! 

ww/wMNewsvm)  oon>  oonw  wjw^^^w 

b.  outside  your  regular  classroom   

(CIRCLE  ONI  ON  EACH  LINE) 
Yes  No 
1  2 
1  2 

(CIRCLE  ONE  ON  EACH  LINE) 
Yee  No 
1  2 
1  2 

21.    Which  of  the  following  beet  describee 
the  science  equipment  you  here  for 
students  in  this  class  to  use? 

1.  Esca  one  usually  has  his/her  own 

2.  One  student  usually  shares  with 

3.  Groups  of  students  (9  or  more) 
usually  share  equipment  

4.  I  hare  little  or  no  equipment  for 

(CIRCLE  ONE) 
1 
2 
3 
4 

(CIRCLE  ONE) 
1 
2 
3 
4 

26.    What  is  the    ndition  of  the  science 
equipment  you  use  in  this  class? 

(CIRCLE  ONE) 

I  have 

Excellent   Good    Fair    Poor  none 
1           2        3        4  S 

(CIRCLE  ONE) 

I  have 

Excellent   Good    Fair    Poor  none 
1           2         3         4  S 

1 

ii  f)08 


f+f  k  mm  J4* 

CLASS  #4 

CLASS  #5 

(CIRCLI  ONI) 
Almost  svary  day   1 

(CIRCLI  ONI) 
Almost  avary  day   \ 

(CIRCLE  ONE) 
Almost  avsry  day    l 

About  OOCO  ft  WMk    J 

About  onco  a  woak   2 

About  one*  a  wask   2 

About  oat*  a  month    3 

Um  than  oasa  a  month    4 

Nora?    | 

Narar    5 

(CIRCLE  ONI  ON  EACH  UNK) 
Yob  No 

1  2 
1  2 

(CIRCLI  ONI  ON  EACH  UNI) 
Yob  No 
1  2 
1  2 

(CIRCLI  ONI  ON  EACH  LINE) 
Yaa  No 
1  2 
1  2 

(CIRCLE  ONI) 
1 
2 
3 
4 

(CIRCLI  ONI) 
1 
2 
S 
4 

(CIRCLE  ONE) 
1 
2 
3 
4 

(CIRCLI  ONI) 

Ihavt 

Excallaat   Good    Fair    Poor  nono 
1           2        S        4  S 

(CIRCLE  ONI) 

I  hart 

Excailont   Good    Fair    Poor  nont 
1           2         3        4  5 

(CIRCLE  ONE) 

;av« 

ExeaUant   Good    Fair    Poor  nont 
1           2         S         4  S 
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PART  III.  TEACHER  BACKGROUND  AND  ACTIVITIES 


What  is  your  sex? 

(CIRCLE  ONE) 

Male    1 

Female    2 


What  is  your  race/ethnicity? 

(CIRCLE  ONE) 


American  Indian  or  Alaskan  Native    1 

Asian  or  Pacific  Islander    2 

Hispanic  or  Spanish   3 

Black,  not  of  Hispanic  Origin    4 

White,  not  of  Hispanic  Origin   5 


What  is  the  year  of  your  birth? 

19  I  |  | 

Counting  this  year,  how  many  years  in  total  (include  part-time)  have  you  taught  at  either 
the  elementary  or  secondary  level? 

I  |  |  Years 

Counting  this  year,  how  many  years  in  total  (include  part-time)  have  you  taught  in  this 
school? 

I  |  |  Years 


In  each  of  the  following  subjects,  please  indicate  the  type  of  certificate  you  hold  from  the 
state  where  you  teach? 

(CIRCLE  ONE  ON  EACH  LINE) 
Provisional, 


a.  Mathematics 

b.  Science 

c.  English 

d.  Social  Studies 


Permanent 
(renewable) 

1 
1 
1 
1 


probationary, 
or  temporary 

2 
2 
2 
2 


Emer- 
gency 

3 
3 
3 
3 


No  cert- 
ification in 
this  area 

4 
4 
4 
4 
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What  is  the  highest  academic  degree  you  hold? 


(CIRCLE  ONE) 

High  school  diploma    1 

Associate  degree/vocational  certification    2 

Bachelor's   3 

Master's   4 

Education  specialist  or  professional  diploma  based 

on  at  least  one  year  work  past  MS  degree  level    5 

Doctorate   6 


What  were  your  major  and  minor  fields  of  study  for  your  highest  academic  degree 

(CIRCLE  ALL  THAT  APPLY) 
MAJOR  MINOR 

a.  Education   1  1 

b.  English   1  1 

c.  History  (or  Social  Studies/ 

Social  Science)    I  1 

<L   Mathematics    1  1 

e.  Physical/natural  sciences    1  1 

f.  Other  (specify) 
  1  1 


Please  prim  th<*  name  of  the  college/university  at  which  you  received  your  Bachelor's 
degree  or  attended  college  and  indicate  the  year  of  your  degree  (or  of  your  most  recent 
attendance).  If  you  have  not  completed  a  Bachelor's  degree,  please  give  the  name  of  the 
college  or  university  at  which  you  earned  the  largest  number  of  college  credits. 

(PLEASE  PRINT  NAME.  DO  NOT  ABBREVIATE.) 

Name  of  College/University  

City,  State  


Year  of  Degree  (or  most  recent  attendance)   19_ 
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10.  Please  print  the  name  of  the  college/university  at  which  you  received  your  Master's  or 
other  graduate  degree  <nd  indicate  the  year  of  your  degree  (or  cf  year  urnst  recent 
attendance).  If  you  havt  not  completed  a  graduate  degree,  please  the  name  of  the 
college  or  university  at  which  you  have  earned  the  largest  number  of  graduate  credits.  If 
you  have  completed  more  than  one  graduate  degree,  please  fill  in  the  information  below 
for  your  highest  degree. 

Not  applicable:  No  graduate  credits   [  ]  (ANSWER  QUESTION  11) 

Name  of  College/Univenity  

City,  State  

Year  of  Degree  (or  most  recent  attendance)   19  


11.  Would  you  agree  to  our  obtaining  your  college/university  transcripts  as  an  additional 
source  of  research  data?  (This  information  would  be  treated  according  to  the  same 
confidentiality  standards  a*  are  detailed  in  the  inside  cover  of  this  questionnaire.) 

(CIRCLE  ONE) 


Yes    1 

No    2 


Signature: 
Date:   


12.     Are  you  proficient  in  any  language(s)  other  than  English?  (CIRCLE  ONLY  ONE) 

(CIRCLE  ONE) 

Yes    1  (ANSWER  Q.13) 

No    2  (SKIP  TO  Q.  17) 


13.     In  what  language<s)  are  you  proficient? 


(CIRCLE  ALL  THAT  APPLY) 


a.  Spanish    01 

b.  Italian   02 

c.  Chinese   03 

d.  French    04 

e.  German    05 

f.  Greek    06 

g.  Japanese    07 

h.  Korean   08 

i.  Portuguese   09 

j.  Any  Filipino  language    10 

k.  Polish    11 

L  Other  (Write  !a)  ....  12 
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14.  Please  answer  the  following  questions  about  the  non- English  language  in  which  you  are 
most  proficient.  (IF  YOU  KNOW  MORE  THAN  ONE  NON-ENGLISH  LANGUAGE, 
ANSWER  WITH  REGARD  TO  THE  LANGUAGE  IN  WHICH  YOU  ARE  MOST 
PROFICIENT.  PLEASE  WRITE  THE  NAME  OF  THAT  LANGUAGE  ON  THE  LINE 
BELOW.) 

Language  B  


15.     With  regard  to  that  language,  how  well  do  you  do  the  following? 

(CIRCLE  ONE  ON  EACH  LINE) 
Very 

How  well  do  you  ...  Well 

a.  Understand  that  language  ...  1 

b.  Speak  that  language   1 

c.  Read  that  language   1 

d.  Write  that  language   1 


Pretty 

Not  Very  Not  at 

Well 

Well 

Well  All 

2 

3 

4  5 

2 

3 

4  5 

2 

3 

4  5 

2 

3 

4  5 

16.  Which  of  the  following  statements  accurately  describes  your  past  experience  with  the 
language  other  than  English  in  which  you  are  most  proficient? 

(CIRCLE  ONE  ON  EACH  LINE) 

Yes  No 

a.  I  am  a  native  speaker  of  the  language    1  2 

b.  The  language  was  the  medium  of  instruction 

for  my  elementary  or  secondary  education   1  2 

c.  The  language  was  the  medium  of  instruction 

for  my  university  studies   1  2 

d.  I  studied  the  language  as  a  foreign  language    1  2 

e.  I  learned  the  language  informally    1  2 

1 7.  What  is  your  employment  status  in  this  school  system? 

(CIRCLE  ONE) 


Tenure  appointment   1 

Reguler  full-time  appointment  without  tenure   2 

Regular  part-time  appointment  without  tenure   3 

Substitute  teacher    4 

Other    5 
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18  During  the  last  12  months,  what  is  the  total  amount  of  time  you  ha-  nent  on  in-service 
education  in  the  subject  you  teach  the  majority  of  the  time?  (In,  lude  attendance  at 
workshops,  continuing  education  programs,  etc.,  but  do  not  include  formal  courses  for 
which  you  have  received  college  credit.) 

(CIRCLE  ONE) 

None   

Less  than  6  hours  .. 

6- 15  hours  

16-33  hours  

More  than  33  hours 


2 
3 
4 
5 


19.     What  type(s)  of  support  for  in-service  education  have  you  received  in  the  last  12  months? 

(CIRCLE  ALL  THAT  APPLY) 

a*  None  •■   1 

b.  Released  time  from  teaching    1 

c.  Travel  and/or  per  diem  expenses    1 

d.  Stipend(s)   1 

e.  Professional  growth  credits    1 

f.  Other  (Specify)   1 


20.    Check  the  one  category  that  best  descrioes  your  current  assignment  for  teaching  English, 
Mathematics,  Science  and/or  Social  Studies,  and  then  supply  the  information  requested. 


Self-Contained  -  You  teach  all  of  these  subjects  to  a 

single  gioup  of  students    1 

a.  Number  of  students  in  your  class    2  |  )  ) 

b.  Number  of  preparations  you  have    2  |  )  ) 

Semi-Departmentalized  -  You  teach  more  than  one,  but  not  all, 

of  these  subjects  to  any  single  group  of  students    2 

a.  Number  of  classes  you  teach    2  |  )  ) 

b.  Number  of  preparations  you  have    2  |  )  ) 

c.  Total  number  of  students  you  teach    2  |  )  )  ) 


Departmentalized  *  You  teach  no  more  than  one  of  these 

subjects  to  any  single  group  of  students  

a.  Number  of  classes  you  teach    2  |  )  ) 

b.  Number  of  preparations  you  have    2  |  )  J 

c.  Total  number  of  students  you  teach    2  |  )  )  | 


21.     Do  you  provide  instruction  in  an  eighth  grade  Gifted/Talented  program  at  this  school? 

(CIRCLE  ONE) 

Yes    1   (ANSWER  Q.22) 

No  ~Z   2  (SKIP  TO  Q.27) 
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22.    What  percentage  of  your  classroom  time  is  speat  in  teaching  students  in  a  gifted/talented 
program? 


Percentage  of  time 


I  I  I  % 


23.    Do  you  have  special  training  in  teaching  gifted  and  talented  children? 


(CIRCLE  ALL  THAT  APPLY) 


a.  No  

b.  Yes,  in-service  training  , 

c.  Yes,  undergraduate  course  credit 

d.  Yes,  graduate  course  credit  

e.  Yes,  continuing  education  credit 


24.    Do  you  have  special  certification  in  teaching  gifted  and  talented  children? 

(CIRCLE  ONE) 

Yes,  provisional  or  temporary   1 

Yes,  permanent  or  long-term  —   2 

No   3 


23.    For  the  gifted/talented  program  in  which  you  teach,  how  satisfied  are  you  with  the 
following: 

(CIRCLE  ONE  ON  EACH  LINE) 

Extremely  Extremely 
Satisfied  Satisfied  Dissatisfied  Dissatisfied 

a*    The  financial  resources  available  for 
this  special  program  

b.  The  content  or  curriculum  of  the 
gifted/talented  program   

c.  The  amount  of  time  available  for 
planning  and  preparation  of 

gifted/talented  instruction    12  3  4 

d.  Student  progress  under  the  program   12  3  4 

e.  The  selection  procedures  for  the 
gifted/talented  program   

f .  The  amount  of  time  allocated 
to  teaching  gifted  classes  


26.     Indicate  the  degree  to  which  each  of  the  following  matters  are  a  problem  in  your  school. 


(CIRCLE  ONE  ON  EACH  LINE) 


Student  tardiness   

Student  absenteeism  

Student  cutting  class   

Physical  conflicts  among  students 

Robbery  or  theft  

Vandalism  of  school  property  

Student  use  alcohol  

Student  use  of  illicit  drugs  

Student  possession  of  weapons  

Physical  abuse  of  teachers  

Verbal  abuse  of  teachers  


Serious 

..  1 

,  1 

,  1 

,.  1 

,  1 

,  1 

,  1 

.  1 

.  1 

.  1 

.  1 


Not  a 


Moderate 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 


Minor 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 


Pro 


lem 


27.    In  addition  to  your  duties  at  this  school,  do  you  hold  another  paying  job  that  is  either  full 
or  part-time? 

(CIRCLE  ONE) 

Yes,  summer  only   1 

Yes,  school  year  only    2 

Yes,  during  the  entire  year    3 

No  .'.   4 


2t.    How  many  days  of  teaching  were  you  absent,  for  any  reason,  during  the  first  semester  of 
the  current  school  year? 

(CIRCLE  ONE) 

No.  duys  absent    1 

1-2  days  rbsent   

3-4  days  absent   

5-7  days  absent  

8-11  days  absent  

12- IS  days  absent  

16-20  days  absent  

21-29  days  absent   8 

30  or  more  days  absent   9 


O 
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29.     How  often  has  someone  from  your  school  or  district  who  has  supervisory  responsibility 
for  ^ally  observed  your  teaching  during  the  first  semester  of  the  current  school  year? 

(CIRCLE  ONE) 

At  least  once  a  week   1 

At  least  once  a  month   2 

Several  times  so  far  this  year    3 

Hardly  ever  or  never   4 


30.     How  much  time  do  ycu  spend  outside  your  regular  school  hours  on  each  of  the  following 
activities  during  a  typical  w*ek  in  addition  to  the  time  you  spend  \i  class? 


None 

a.  Planning  and  preparing 

for  teachur    1 

b.  Correcting  papers    1 

c.  Other  record  keeping/ 
paperwork   1 

<L    Meeting  with  other 
teachers  on  lesson 
planning,  curriculum 
development,  guidance  .  1 

e.  Coordinating  a 
curriculum  area  or 
department    1 

f.  Supervising  students 
(halls,  lunchroom,  study 
hall,  playground)   1 

g.  Coaching  or  advising 
extracurricular 

activities    1 

h.  Communicating  with 
parents    1 


<1 
hr. 

2 
2 


(CIRCLE  ONE  ON  EACH  LINE) 


2 
2 


1 

hr. 


3 
3 


2 

hrs. 

4 
4 


4 
4 


3 
hrs. 

5 
5 


4 
hrs. 

6 
6 


6 
6 


5+ 
hrs. 


6* 
hrs. 

8 
8 


31.    Since  the  beginning  of  the  current  school  year,  how  many  students'  parents  (or  guardians) 
have  you  talked  with  individually  regarding  their  child's  classroom  performance? 

(CIRCLE  ONE) 


None    1 

1-4  students'  parents   2 

5-9  students9  parents   3 

10-19  student*9  parents   4 

20-29  students9  parents    5 

30-39  students9  parents   6 

40-59  students9  parents   7 

60  or  more  students'  parents    8 


O  20       n  t  n 

ERIC  6<7 


32.  How  much  time  each  week  do  students  in  your  classes  make  use  of  microcomputers  for 
instructional  purposes  related  to  the  material  you  cover  in  your  classes  (excluding 
computer  literacy,  programming  and  the  like)? 

(CIRCLE  ONE) 


We  have  no  facility  in  our  school 

for  this  purpose    1  (SKIP  TO  Q.35) 

None  (we  have  such  a  facility,  but  I 

don't  use  it)    2  (SKIP  TO  Q.35) 

Less  than  one  hour  per  week   3 

One  hour  per  week   ~   4 

Two  hours  per  week    5 

Three  hours  per  week    6 

Four  hours  per  week   7 

Five  or  more  hours  per  week   8 


33.     What  proportion  of  your  students  use  a  microcomputer  for  this  kind  Ok  instructional 
purpose  on  a  regular  basis? 

(CIRCLE  CNE) 


None  -  1 

Fewer  than  *J%   2 

11-25%    3 

26-50%    4 

51-75%    5 

76-90%    6 

More  than  90%    7 


34.     Which  of  the  following  best  d    ,ribes  how  you  make  instructional  use  of  microcomputers 
with  these  students? 

(CIRCLE  ONE) 

Totally  for  enrichment  purposes    I 

Mainly  for  enrichment  purposes,  a  litt'e 

for  remedial  purposes    2 

About  equally  split  between  enrichment  and 

remedial  purposes   3 

Mainly  for  remedial  purposes    4 

Totally  for  remedial  purposes    5 


35.     How  many  person-hours  were  required  to  complete  this  form? 


Hours  Minutes 


36.     Please  provide  the  information  requested  below  so  we  can  reach  you  if  any  clarification 
of  your  responses  is  needed. 


Name 

(_  _J   |  |  Home  or      Best  time  of  AM 

Telephone  Number         |  J  Office        day  to  call:   PM 
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OMB  No.  1850-0593 
Expirtt  Junt  30,  1987 


SCHOOL  QUESTIONNAIRE 
NELS:  88 

NATIONAL  EDUCATION  LONGITUDINAL 
STUDY  OF  1988 
FIELD  TEST 


Prepared  for 

U.S.  Ociiartmem  of  Education 
Ceatar  f^r  Education  Statistics 


Prepared  t7: 
NORC, 

A  Social  Science  Research  Center 
University  of  Chicago 


SCHOOL  NO.:  |  |  | 


As  a  matter  of  policy,  the  Center  for  Education  Statistics  is  concerned  with  protecting  the 
privacy  of  individuals  who  participate  in  voluntary  surveys.  We  want  to  let  you  know  that: 

Section  406  of  the  General  Education  Provisions  Act  (20-USC  I221e-1)  allows  us  to  ask 
you  the  questions  in  this  questionnaire. 
You  may  skip  any  questions  you  do  not  wish  to  answer. 

We  are  asking  you  these  questions  in  order  to  gather  information  about  what  happens  to 
students  as  they  move  into  high  school  and  make  decisions  about  postsecondary  education 
and  worh. 

Your  responses  w,^  be  merged  with  those  of  other  respondents,  and  the  answers  you  give 
will  never  be  identified  as  yours. 


R20 


This  questionnaire  is  directed  to  the  school  principal.  It  is  divided  into  8  sections 
or  "Parts."  Parts  1  -  6  request  mainly  factual  information  about  this  school  and  its  programs. 
These  sections  can  be  answered  either  by  the  principal  or  hv  a  designee  who  is  able  to  provide 
the  requested  information*  The  final  sections.  Parts  7-8,  request  judgmental  evaluations  about 
the  school  climate,  and  we  ask  that  these  sections  be  completed  by  the  principal  personally. 

Some  factual  questions  may  request  information  that  is  not  readily  available  from 
school  records  (e.g.,  the  racial/ethnic  composition  of  the  eighth  grade  student  body).  Informed 
estimates  are  acceptable  for  such  questions.  Your  estimates  will  be  better  than  ours.  Please 
answer  directly  on  the  questionnaire  by  circling  the  appropriate  number  or  by  writing  your 
response  in  the  space  provided. 

We  realize  that  you  are  very  busy;  however,  we  ask  that  you  complete  the 
questionnaire  and  return  it  to  your  school's  study  coordinator  within  the  next  two  w«eks  (or 
sooner,  if  asked  by  the  coordinator).  To  protect  the  confidentiality  of  your  responses,  we 
suggest  that  you  return  the  completed  questionnaire  to  its  original  envelope  and  then  sral  the 
envelope  before  turning  it  in. 

Thank  you  very  much  for  your  help. 
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PART  1.  SCHOOL  CHARACTERISTICS 


1.  Circle  all  grade  levels  included  in  your  school. 

PIC  K  01  02  03  04  05  06  07  08  09  10  11   12  13+ 

2.  As  of  October  1,  1986  (or  the  nearest  date  for  which  data  are  available),  what  was  the 
total  student  enrollment  in  your  school? 

I    I    I    I     I  Number 

3.  As  of  October  1,  1986  (or  the  nearest  date  for  which  data  are  available),  what  was  the 
total  eighth-grade  student  enrollment  in  your  school? 

I    I    I    I     I  Number 

4.  Which  category  best  describes  your  school? 

(CIRCLE  ONE) 

Public  school   1 

Private  or  Catholic 

Diocesan   2 

Parish   3 

Religious  Order    4 

Private,  Other  Religious  Affiliated   5 

Private,  Not  Religious  Affiliated    6 

5.  What  is  the  major  program  orientation  for  eighth  grade  students  in  your  school? 

(CIRCLE  ONE) 

General  (comprehensive)   1  (SKIP  TO  Q6) 

Specialized   2  (GO  TO  A) 

(CIRCLE  ONE) 

A.   Science/technology    1 

Arts    2 

Vocational   3 

Handicapped   4 

Gifted    5 

Other  (write  in) 


6 
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6.      How  many  days  are  in  the  school  year  for  eighth  grade  students  in  your  school? 

L  — |  |  |  Number  of  school  days 


7.     How  many  class  periods  are  in  the  school  day  for  eighth  grade  students  in  your  school? 

I  |  |  Number  of  class  periods 


8.      How  many  minutes  long  are  class  periods  for  eighth  grade  students  in  your  school? 

I  |  |  |  Number  of  minutes 


9.  Please  provide  the  name,  address,  and  grade  span  of  the  schools  that  students  in  your 
school  would  commonly  attend  upon  cc^oletion  of  the  eighth  grade.  In  addition,  indicate 
the  percentage  of  eighth  grade  students  you  would  expect  to  attend  each  of  the  schools 
you  list  below. 

Percentage 
Grade  expected 


Name                           Address  span  to  attend 

A.        % 

B.  ;        % 

C        % 

D.        % 
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PART  2.  STUDENT  CHARACTERISTICS 


1.  What  is  the  average  daily  attendance  rate  for  eighth  grade  students  in  your  school? 
(Include  both  excused  absences  and  unexcused  absences  in  figuring  this  rate.) 

I  I  I  I  % 

2.  On  the  average,  what  percentage  of  eighth  grade  students  enrolled  at  the  beginning  of  the 
school  year  are  still  enrolled  at  t  end  of  the  school  year?  (Exclude  transfers  from  other 
schools  in  figuring  this  rate.) 


LJ_J_J  % 

3.      What  percentages  of  your  current  eighth  grade  students  are  members  of  the  following 
groups?  (Percents  should  sum  to  100) 


American  Indian  or  Alaskan  Native   |  J  |  |  % 

Asian  or  Pacific  islander   I  J  |  J  % 

Hispanic   I  I  •  j  J  % 

Black,  not  of  Hispanic  origin    |  J  J  J  % 

White,  not  of  Hispanic  origin   I  J  J  J  % 


4.      What  percentage  of  the  eighth  grade  students  enrolled  in  your  school  are  male? 

I  I  I  I  % 


S.      What  percent  of  your  eighth  grade  students  would  you  estimate  live  in  a  single  parent 
family? 

(CIRCLE  ONE) 


None    1 

l%-25%      2 

26%-50%    3 

51%-75%    4 

76%-99%    5 

All   6 

Cannot  estimate    7 
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For  each  of  the  academic  subjects  listed  below,  indicate  if  eighth  grade  students  are 
ability  grouped  for  instruction. 


(CIRCLE  ONE) 
Yes  No 

English/Reading   1    2 

Mathematics   1    2 

Science   '    2 

Social  Studies/History    i    2 


What  percent  of  the  eighth  grade  students  are  limited  English  proficient  (LEP)? 
Circle  the  Percentage  Range  that  Represents  Yoar  Best  Estimate 

(CIRCLE  ONE) 


10%  or  less   01 

11-20%    02 

21-30%    03 

31-40%    04 

41-50%    05 

51-60%   -   06 

61-70%    07 

71-80%    08 

81%  or  mc/e    09 


How  many  teachers  are  assigned  to  teach  English  language/language  assistance  classes  for 
eighth  grade  (for  example  LEP  classes  or  ESL  classes)?  Please  provide  your  best  estimate. 
Include  part-time  teachers. 


Number  of  teachers   |  |  |  | 


Please  indicate  which  of  the  following  subjects  are  offered  by  your  school  at  the  eighth 
grade. 

(CIRCLE  ONE  FOR  EACH  LINE) 
YES  NO 


a.  English  taught  to  LEP  students 

b.  Foreign  language  courses  

c.  Academic  subjects  taught  in: 


English  

Spanish  

Italian  

Chinese  

French   

German  

Greek   

Japanese   

Korean  

Portuguese  

Any  Filipino  language 
Polish   


Other  (Write  in) 


d.    Which  academic  subjects  are  taught  in  a  foreign  language? 


English/reading  

Mathematics   

Science  

Social  studies/ history 


2 
2 

2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 


2 
2 
2 
2 


What  percent  of  Ae  students  in  your  school  receive  the  following  special  services?  (If 
service  is  not  provided,  write  in  000.) 


Federal  free  and  reduced-price  school 

lunch  program   I  I  I — I  * 

Remedial  reading    ! — I — I — I  J 

Remedial  math   I  I  I — I  % 

Bilingual  education    I  I  I — I  % 

English  as  a  Second  Langu  ge  Training 

(not  Bilingual  Education)    I  I  I — I  %- 

Special  Education   I  I  I — I  * 

Gifted  and  talented  education    I  I  I — I  % 

Occupation/job  training   ,   I  I  I — I  % 


PART  3.  TEACHING  STAFF  CHARACTERISTICS 


1.  How  many  full- time  regular  teachers  work  in  your  school? 

|  |  |  |  Number 

2.  How  many  part-time  teachers  (for  example  substitutes,  itinerant  teachers,  etc.)  work  in 
your  school? 

1     I    I  |  Number 

3.  How  many  full-time  regular  teachers  teach  the  eighth  grade  in  your  school? 

|  |  |  |  Number 


4.      How  many  part-time  teachers  (for  example  substitutes,  itinerant  teachers,  etc.)  teach  the 
eighth  grade  in  your  school? 

I  |  |  |  Number 


S.      What  is  the  major  way  your  eighth  grade  teaching  staff  delivers  English,  Mathematics, 
Science,  and  Social  Studies  instruction? 

(CIRCLE  ONE) 

Self-contained  -  one  teacher  teaches  all  of  these 
subjects  to  the  same  group  of  student*    1 

Departmentalized  -  a  given  teacher  teaches  no 

more  th*u  one  of  these  subjects  to  a  single 

group  of  students    ? 

Semi-aepartmentalized  -  a  given  teacher  teaches  more 
than  one,  but  not  all  of  these  subjects  to  a  single 
group  of  students    3 


6.  What  is  the  base  salary  for  a  beginning  teacher  with  a  bachelor's  degree  in  your  school 
district?  Give  either  the  dollar  amount  or  the  range. 

$|  |  ),|  |  )  |.00  -  Dollar  amount  Or 

$1  |  M  |  |  J.00  to  $|  |  |,|  |  |  J.00  -  Range 

7.  How  many  full-time  teachers  on  your  regular  teaching  staff  have  taught  for  less  than 
three  yean? 

|  |  |  |  Number 


6  627 


What  percentages  of  your  full-time  regular  teaching  staff  are  members  of  the  following 
groups? 


American  Indian  or  Alaska  Native   I  |  |  |  % 

Asian  or  Pacific  Islander   I  |  |  |  % 

Hispanic   |  |  |  |  % 

Black,  not  of  Hispanic  origin    |  |  |  |  % 

White,  not  of  Hispanic  origin   |  |  |  |  % 


How  many  members  of  your  full-time  regular  teaching  staff  have  a  degree  beyond  the 
bachelor's  degree? 

I  |  |  |  Number 


Is  the  regular  teaching  s&ff  in  your  school  covered  by  a  collective  bargaining 
procedure(s)? 

(CIRCLE  ONE) 

Yes   1 

No   2 

Regulations  prohibit  such  procedures   3 


• 
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PART  4.  SCHOOL  POLICIES  and  PRACTICES 


Which  of  the  following  best  describe  the  practices  for  assignment  of  students  to  your 
school? 

(CIRCLE  ALL  THAT  APPLY) 

All  pupil*  in  a  particular  geographic  area 

(or  district)  attend  this  school   1 

Pupils  in  a  particular  geographic  area  (or  district) 
are  generally  assigned  to  this  school  but  transfers 
are  frequently  allowed   2 

Pupils  are  assigned  from  particular  areas  to  achieve 

desired  racial  or  ethnic  composition  in  the  school   3 

Pupils  are  assigned  to  this  school  based  on  an 

entrance  test  or  other  achievement  criteria    4 

Other  (specify)    5 

Private  school,  does  not  apply   6 

Does  your  school  have  formal  admission/application  procedures? 


How  many  students  applied  for  admission  to  your  school  for  the  current  school  year? 


How  many  applicants  were  accepted  for  admission  to  your  school  for  the  current  school 


I  |  I  I  I  Numoer 

How  many  applicants  were  accepted  for  admission  to  y 
year? 

I  |  |  |  |  Number 

,629 


How  often  is  consideration  given  to  the  following  items  regarding  your  school's  admission 
practices? 

(CIRCLE  ONE  ON  EACH  LINE) 
Always      Usually    Sometimes    Seldom  Never 

Level  of  performance  on 
standardized  achievement 

or  aptitude  test   1    2    3   


Level  of  performance  on 

written  admission  test   1    2    3 


Personal  interview  with 
parent/guardian  

Personal  interview  with 
student   


1 


Recommendation  of  a  former 
principal    1 


Recommendation  of  a 
former  teacher  


1 


2 
2 
2 
2 


3 
3 


Recommendation  from  a 
n on -family  friend 

(e.g.,  pastor,  rabbi)    1    2    3 

Strong  academic  record    1    2    3 


Does  your  school  have  a  policy  requiring  students  to  maintain  a  minimum  grade  point 
average  in  order  to  participate  in  school  activ4  ies  such  as  sports? 


(CIRCLE  ONE) 


Yes 
No 


1 

2 


Does  your  school  have  a  written  staten>~at  of  standards  for  st  jdent  behavior  (discipline)? 


(CIRCLE  ONE) 


Yes 
No 


Is  this  a  public  school? 


(CIRCLE  ONE) 

Yes    1   (SKIP  TO  PART  5,  Q.l) 

No    2 


fl30 


9.     Whit  is  tha  maximum  yearly  tuition  to  attend  your  school? 

SI  |  U    I    i    LOO  -  Amount 


10.    What  percentage  of  your  students  pay  the  maximum  yearly  tuition? 

(CIRCLE  ONE) 


0%-25%    i 

26%-50%    2 

5i%-75%    3 

76%- 100%    4 


11.    For  what  percentage  of  the  students  in  your  school  are  you  currently  providing  finarcial 
aid? 

No  provisions  for  financial 

aid  are  provided      000 


I    I    |  J% 


12.    In  regards  to  your  school's  admissions  practices,  how  often  is  consideration  given  to  the 
student's  (family's)  ability  to  pay  your  school's  tuition? 

(CIRCLE  ONE) 


Always  considered  ;   i 

Usually  considered    2 

Sometimes  considered    3 

Seldom  considered   4 

Never  considered   5 


ERJC 
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PART  5.  GRADING  AND/OR  TESTING  STRUCTURE 


List  the  standardized  tests  that  are  used  to  assign  eighth  graders  to  high  school 
courses/programs.  For  each*  list  the  name  of  the  test  that  is  used,  the  grade  level  at  which 
it  is  administered,  and  the  date  of  its  last  administration  (for  example  09  22  86). 

Test  Name  Grade  Level  Date 

  I  |  1 1  I  I  l_J  I 

Mo.       Day  Yr. 

 .   L_L_I  l_J_J  L_L_I 

Mo.       Day  Yr. 

    l_|_|  l_|_|  l_l_l 

Mo.       Day  Yr. 

  I  I  1 1  I  1 1  I  I 

Mo.       Day  Yr. 


For  each  item  listed  below,  indicate  the  level  of  influence  each  has  in  the  assignment 
and/or  selection  of  high  school  courses/ programs  for  eighth  grade  students  in  your  school. 

(CIRCLE  ONE  ON  EACH  LINE) 

A  Lot      Moderate     A  Little  None 

1    2    3    4 

1    2    3    4 

1    2    3    4 

i    2    3   4 


Counselors 
Teachers  ... 

Parents   

Test  Scores 


How  often  are  students'  standardized  test  results  provided  to  teachers? 


Always       Usually    Sometimes    Seldom  Never 
1  2  3  4  5 


Hov  often  are  standardized  test  results  provided  to  families  of  students? 

Always       Usually    Sometimes    Seldom  Never 
1  2  3  4  5 


How  often  are  standardized  test  results  used  for  counseling  purposes? 

Always       Usually    Sctietimes    Seldom  Never 
1  2  3  4  5 


ii  r>32 


Are  eighth  grade  students  required  to  pass  minimum  competency  tests  in  any  of  the 
following  subject  areas? 


(CIRCLE  ONE  FOR  EACH  LINE) 


YES  NO 

Competency  test  for  reading   1    2 

Competency  test  for  mathematics   1    2 

Competency  test  for  science    1    2 

Competency  test  for  social  studies    1    2 

Competency  test  for  English/language  arts    1    2 
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PART  6.  SCHOOL  PROGRAMS 


How  much  instruction  is  required  for  eighth  grade  students  in  each  of  the  following 
subjects? 

(CIRCLE  ONE  ON  EACH  LINE) 


English/Reading   

Mathematics  

Science  

Computer  Education  . 

Social  Studies/History 

Foreign  Language  

Art   

Music  

Physical  Education  .... 

Family  Life  and 

Sex  Education   


Moral/Ethics  Education 

Religious  Education   

Career  Guidance  

Vocational  Exploration 

Industrial  Arts   

Homemaking   


No 
Specific 
Amount 


Full 
Year 

..  2 

...  2 


2 
2 
2 
2 
2 
2 
2 

2 

2 
2 
2 
2 
2 
2 


Less  Than 
One-Half  One-Half 
Year  Year 


Does  your  school  offer  special  remedial  programs  in  any  of  the  following  subject  areas 
for  eighth  grade  students? 

(CIRCLE  ONE  ON  EACH  LINE) 
YES  NO 

Reading   1    2 

Mathematics   ~   1    2 

Social  studies/history    1    2 

Science    !    2 

English/language  arts    1    2 
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Is  there  a  Gifted/Talented  program  for  the  eighth  grade  students  in  your  school? 

(CIRCLE  ONE) 

Yes    1  (GO  TO  Q.4) 

No    2  (SKIP  TO  Q.8) 


4.      What  subjects  does  that  program  cover? 


Mathematics  

Science   

English/Literature  ... 

Social  Studies   

Foreign  Language(s) 
Computer  Science  .... 

Music  

Art  

Other  (Write  in)  


(CIRCLE  ALL  THAT  APPLY) 


5.  Does  gifted/talented  instruction  take  place  primarily  within  your  school/school  building, 
or  primarily  outside  it  (for  example,  at  another  school)? 

(CIRCLE  ONE) 

Within  this  school   1 

At  some  other  location   2 

6.  Which  of  the  following  statements  BEST  describe  the  way  righth  grade  gifted  and 
talented  nstruction  is  organized  for  the  students  in  your  school: 

(CIRCLE  ALL  THAT  APPLY) 

Students  are  taken  from  their  regular  classes 

for  supplemental  gifted/talented  instruction   1 

Gifted/talented  students  are  grouped  together 
for  all  or  most  subjects  and  have  their  own 
curriculum  ,   i 

Gifted/talented  students  are  given  enriched 

instruction  only  in  the  particular  subjects  in 

which  they  excel    1 

Gifted/talented  students  are  given  supplemental 
instruction  within  their  own  classroom    1 

Other  arrangement 

Please  specify  ,  t    1 


ERIC 


What  main  factors  are  considered  in  the  selection  of  students  for  the  lifted  and  talented 
program? 

(CIRCLE  ALL  THAT  APPLY) 

Scores  on  standardized  examinations  given  to 

all  student   1 

Addition  J  test  results   1 

Teacher  or  counselor  recommendations 

and  reports   1 

Parental  requests  ,   I 

School  grades   I 

Providing  opportunities  for  racial  and  ethnic 

groups   .  ....   i 

Personal  interview   I 

Student  requests    1 

Other  (please  specify)  .....  i 
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What  percentage  of  your  t  .ith  g:     .3  participate  in  the  activities  listed  below? 


Activity 

Not 
Available 


(CIRCLE  ONE  ON  EACH  LINE> 
Less 


Than 
10% 


Academic  honor  societies 

Band  

Chorus  or  choir  

Computer  club   

Dr»ma  clubs   

Service  clubs  , 

Mathematics  club  , 

Science  club  


Other  subject  matter 
clubs  (e.g.,  history)  „  

Science  fairs   

Student  councils)  

Student  newspaper  

Student  yearbook   

Foreign  language  clubs  

Orchestra   

Religious  organizations  

Debate  or  speech  teams   

Intencholastic  sports  

Intramural  sports  

Vocational  education  clubs 

Cheer-leading  and  related 
activities   


ll%-20% 

  3  ... 

  3  .... 

  3  ... 

  3  ... 

  3  ... 

  3  ... 

  3  ... 

  3  ... 


3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 


21%-50%  51%- 

  4   


4 
4 
4 
4 
4 
4 


4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
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PART  7.  SCHOOL  CLIMATE 


For  each  of  the  characteristics  listed  below  which  help  to  define  the  climate  of 
school,  indicate  how  much  it  describes  your  school. 


Not  at  all 
accurate 
for  this 
school 


(CIRCLE  ONE  ON  EACH  LINE) 


There  is  conflict  between 
teachers  and  administrators 

Discipline  is  emphasized 
at  this  school   


Students  place  a  priority 
on  learning   

The  classroom  environment 
for  students  is  structured  ... 


Teachers  at  this  school 
press  students  to  do 
their  best   


1 


Students  are  expected 

to  dc  homework    1    2 

Teacher  morale  is  high   1    2 

Teachers  have  a  negative 

attitude  about  students    1    2 


Teachers  find  it  difficult 
to  motivate  students  


1 


The  school  day  for 

students  is  structured   1    2 


Deviation  by  students 
from  school  rules  is 
not  tolerated  


1 


The  school  environment 

is  "flexible"    1 

Teachers  take  the  time 
to  respond  to  students1 
individual  needs   1 


The  school  emphasizes 
sports  


Students  face  competition 
for  grades   


Very  much 
accurate 
for  this 
school 
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2. 


Please  indicate  which  of  the  following  exists  in  your  school. 


(CIRCLE  ONE  ON  EACH  LINE) 
YES  NO 


Visitors  required  to  sign  in  at  the  main  office    1  2 

Hall  passes  required: 

Library   1  2 

Lavatory   „   1  2 

Office    1  2 

Counselor   1  2 

No-smoking  rules  prohibiting  smoking  by 

students  in  school  or  on  school  grounds    1  2 

Academic  counseling  for  students   1  2 

Behavicxal  problem  counseling  for  students    1  2 

Vocational  counseling  for  students   1  2 

Rules  about  student  dress: 

Uniform  required    1  2 

Certain  forms  of  dress  forbidden   1  2 

Students  prohibited  from  leaving  school 

or  school  grounds  during  school  hours   ~   1  2 


3.      Indicate  the  degree  to  which  each  of  the  following  matters  is  a  problem  in  your  school. 

(CIRCLE  ONE  ON  EACH  LINE) 

Not  a 

Serious     Moderate      Minor  Problem 

Student  tardiness    1    2    3    4 

Student  absenteeism    1    2    3    4 

Student  cutting  class   1    2    3    4 

Physical  conflicts 

among  students    1    2    3    4 

Robbery  or  theft    1    2    3    4 

Vandalism  of  school 

property   1    2    3    4 

Student  use  of  alcohol   1    2    3    4 

Student  use  of 

illicit  drugs   1    2    3    4 

Student  possession  of 

weapons    1    2    3    4 


Physical  abuse  of 

teachers    I 

Verbal  abuse  of 

teachers    1 
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PART  8.  SCHOOL-PARENT  INTERACTIONS 


What  percentage  of  your  eighth  grade  students  have  families  who  are  involved  in 
volunteer  work  at  your  school? 

Less 

None      than  10%    11%- 20%    21%-50%  51%-100% 
0  12  3  4 


Do  the  following  practices  exist  in  your  school? 


(CHICLE  ONE  ON  EACH  LINE) 
YES  NO 


Parents  notified  of  unexcused  absences    1    2 

Parents  are  given  interim  reports  during 

the  grading  period  if  grades  are  low   1    2 

Parents  notified  when  student  sent  to 

the  office  for  disruptive  behavior   1    2 

Parent  conferences  scheduled  at  the 
parent's  request  to  discuss  student 

behavior  and/or  performance    1    2 

Parent  conferences  scheduled  at  the 
school's  request  to  discuss  student 

behavior  and/or  performance   1   2 

Parents'  participation  as  volunteers 

is  encouraged  by  the  school    1    2 

Parents  are  encouraged  to  be  involved 
in  policy  decisions  (e.g.,  addition 

of  new  programs)   1    2 

Parent-school  associations  are 

encouraged  by  the  school    1    2 


How  often  are  individual  parent/ teacher  conferences  held? 

(CIRCLE  ONE) 


More  than  once  a  month    1 

Several  times  a  semester    2 

Once  a  semester   3 

Once  a  year   4 

Never   5 
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In  your  school  what  happens  to  a  student  who  is  caught  doing  one  of  the  following? 
(Expulsion  means  the  student  a  asked  to  permanently  withdraw:  suspension  means  the 
student  is  asked  to  leave  for  a  period  of  time,  but  is  permitted  to  come  back  ta  the 
school.) 

FIRST  OCCURRENCE 

(CIRCLE  ONE  ON  EACH  LINE) 

Minor 
No  Discipl. 
Action       Action    Suspension  Expulsion 


Cheating   

  1   

  2 

Physical  injury  to 

A 

  1 

PfttMwtinn  nf  alcohol 

A 

Possession  of 

  2 

Possession  of  weapons 

...  0   

  2 

Use  at  school  of  alcohol 

...  0   

,  2 

Use  at  school  of 

illicit  drugs  

  2 

Smoking  at  school  

...  0   

2 

Verbal  abuse  of 
teacher  or  staff  member 

...  0   

  2 

Physical  injury  to  a 
teacher  or  staff  member 

...  0   

2 

Theft  of  school  property 

...  0   

,  2 

Classroom  disturbance 

...  0   

  2 

Use  of  profanity  

...  0   

  2 

641 
20 


In  your  school  what  hapoens  to  a  student  who  is  caught  doing  one  of  the  following? 
(ExpuMon  means  the  student  is  asked  to  permanently  withdraw,  rspension  means  the 
student  is  asked  to  leave  for  a  period  of  time,  but  is  permitted  to  come  back  to  the 
school.) 

REPEATED  OCCURRENCE 

(CIRCLE  ONE  ON  EACH  LIN*.) 

Minor 
No  Discipl. 
Action       Action    Suspension  Expulsion 

Cheating   0    1    2    3 

Physical  injury  to 

another  student    0    1    2    3 

Possession  of  alcohol    0    1    2    3 

Possession  of 

illicit  drugs   0    1    2    3 

Possession  of  weapons   0    1    2    3 

Use  at  school  of  alcohol    0    1    2    3 

Use  at  school  of 

illicit  drugs   0    1    2    3 

Smoking  at  school   0    1    2    3 

Verbal  abuse  of 

teacher  or  staff  member    0    1    2    3 

Physical  injury  to  a 

teacher  or  staff  member    0    1    2    3 

Theft  of  school  property    0    1    2    3 

Classroom  disturbance   0    1    2    3 

Use  of  profanity   0    1    2    3 

How  many  person- hours  were  required  to  complete  this  form? 


Hours  Minutes 

Please  provide  the  information  requested  below  so  we  can  reach  you  if  any  clarification 
of  your  responses  is  needed. 


Name 


(       )  |  |  Home  o*     Best  time  of  AM 

Telephone  Number  I  |  Office        day  to  call:   PM 
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Dear  Student: 

The  New  York  State  Education  Department  has 
taken  the  opportunity  to  add  special  questions 
to  this  survey. 

The  Information  will  be  used  as  an  important 
part  of  an  evaluation  of  the  Regents  Action 
Plan. 

Your  cooperation  xn  completing  this  supplement 
is  appreciated. 

Gordon  M.  Ambach 
Commissioner  of  Education 
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Office  UM  »ly 
V*tleaem» 
Nte  vert  V*?ie«ent  ill        Q/ / 


Questions  fur  Mm  York  Seat*  Field  Test 
Student  Questionnaire  Augmentation  NELS:88 
Ceo  you  Ute  any  course  giver  in.  your  school? 

(aicu  our) 

Yes  ..c   I 

No    2 

Generally  speaking,  how  veil  do  you  like  the  courses  given  in  your  school? 

(CIRCLE  (MB) 

1  like  rhe  courses  very  mu^a    1 

I  like  the  courses  sosievhat    2 

I  dislike  the  courses  somewhat    1 

I  dislike  the  courses  very  nuch    4 

Generally  speaking,  how  successful  do  you  feel  you  have  been  in  the  courses 
you  have  taken? 

(CIRCLE  ONE) 

Very  sl    *ssful    i 

Somewhat  successful  2 

Not  at  all  successful    3 

Are  you  going  to  work  coward  a  Regents  diploma? 

(CIRCLE  ONE) 

Ym   •     •  I  — >  SKIP  TO  Question  6,  next  page 

No    2  ~ >  GO  to  Question  5,  next  page 

Not  sur*    3  ~>  GO  TO  Question  5,  next  pege 


I 
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5.  If  you  arc.  not  going  to  work  low  rds  a  Regents  diploma,  why  not? 

(CI1CLI  ALL  THAT  APPLY) 

Too  hard"  i„   I  12/ 

Too  many  courses  required   I  13/ 

Don't  want  to  take  a  foreign  langu^j   I  14/ 

Other  (UtITB  IN)   !  l5/ 

6.  In  which  subjects  do  you  plan  to  take  sequence*  (3  credits)  in  high  school? 

(CIRCLE  ALL  THAT  APPLY. 
Mather  itics  (.  .   1 

Foreign  Languages    1  ^-j/ 

Science   1 

Music/ Art  ,   i 

Occupational/Vocational  Education    1 


7.  Are  you  ».iing  to  take  a  foreign  language  in  high  school? 

(CIRCLE  OMB) 

Yes    1  — .  skip  TO  Question  9,  next  page 

Mo   2  — >  00  TO  Question  8 

Mot  sure   3  — >  GO  TO  Question  8 

8.  If  you  are  not  going  to  take  a  foreign  language  in  high  school,  why  not? 

(CIRCLE  ALL  THAT  APPLY) 

Foreign  language  is  too  hard  

A  foreign  language  won't  be  useful  to  me  in  later  life   

My  school  doesn't  offer  the  foreign  language  I  want   

I'm  not  interested  in  a  Regents  diploma   

Other  (URITB  IM)   


18/ 
19/ 
20/ 


21/ 


22/ 
23/ 
24/ 
25/ 
26/ 
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9.    Art  you  Caking  any  remedial  cliuti? 

(C1ACLE  QMS) 


27/ 

*•   2  — >  SKIP  TO  Quettion  12,  next  j.  g« 

10.  Do  yov,  spend  lost  ciae  in  your  regular  cUssts  than  other  students  because 
of  remedial  work? 

(CI1CL2  0MB) 

  «         1  — >  GO  TO  Cues t ion  11 

„  28/ 
"°  «  2  —  >  SKIP  TO  Question  12,  next  page 

'  I.  If  yes,  check  the  subjects  in  which  you  lose  clsss  tie*  because  of  remedial 
work. 

(CIKCLB  ALL  THAT  APPLY) 

English    i  .  29/ 

Social  Studies                                                                1  30/ 

Science   t  „  ,                           I  31/ 

Mathematics                                                                 I  32/ 

Technology  Education                                                       I  33/ 

Home  end  Career  Skills                                                    I  34/ 

Physical  Education                                                          1  35/ 

Health  Education                                                            1  36/ 

Art  ,                                                                                1  37/ 

Music                                                                                1  33/ 

Library  and  Information  Skills                                        1  39/ 

Poreign  Language                                                             1  40; 

Other  (WRITE  IM)  ...  I  41/ 

3 
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12.  How  important  is  ic  £or  you  to  do  ««ch  of  th«  following? 

(CUCU  ONE  OH  EACH  LIMB) 

Noc 

Very      Soeuvhat  Important 
Important    Important     Unimportant       Ac  All 


a.  Attend  school  on  s  rsgulsr  bssis  ....  1   2    3 

b.  Finish  high  school    1   %    3 

c.  G«C  s  Began cs  diploma    1   2   3 


4 
4 
4 


42/ 
43/ 
44/ 


13.  Are  high  school  courses  available  to  eighth  graders  in  your  school? 

(CIBCLB  OBB) 

*«*    1  — >  GO  TO  Question  14 

*>   2  —  >  SUP  TO  Question  13 

Don't  know   8  —  >  SUP  TO*Question  13 

14.  Are  you  taking  a  high  school  course  this  year? 

(CIBCLB  OMB) 

 1  — >  STOP 

Ho   2  —>  GO  TO  Question  13 

15.  Check  the  subjects  in  which  you  would  like  to  have  taken  a  high  school 
course  this  year. 

(CIBCLB  ALL  THAT  APPLY/ 


English  , 

Social  Studies   

Poreign  Language   

Art   

Music   

Occupational /Vocational  Education 

Mathematics   

Science   

4 


45/ 


46/ 


47 
48 
49 
50 
51 
52 
!3 
54 


f>48 
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The  accompanying  materials  are  similar  to  those  used  in  the  NELS:88  FieLd 
Test.    They  include  reading,  U.S.  hi stor> /ci tizenship/geography,  science,  and 
mathematics  questions  designed  to  provide  information  about  the  -ange  of  eighth, 
tenth,  and  twelfth  grade  students'  knowledge  and  skills. 
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SAMPLE  ITEMS  -  NELS  READING  TEST 


T»s«h  directions: 

Read  each  passage  carefully  and  then  answer  the  questions  about  it. 
For  each  question,  decide  on  the  basis  of  the  passage  which  one  of 
the  choices  best  answers  the  question.     Draw  a  circle  around  the 
letter  of  the  answer  you  choose 


Qyftfrfalona  1-4  refer  to  the  following  passage. 

I  am  not  sure  that  I  can  draw  an  exact 
line  between  wit  and  humor,  but  I  am 
positive  that  humor  is  the  more  comfortable 
quality.    Humorous  persons,  if  their  gift 
(5)  is  genuine,  are  always  agreeable  companions. 

They  have  pleasant  mouths  turned  Up  at  the 
corners.    To  those  corners  are  tied 
marionette  strings  that  twitch  at  the 
slightest  jest.     But,  the  mouth  of  a  merely 
(10)  witty  person  is  hard  and  sour  right  up  until 

the  moment  of  discharge.     Rarely  is  the 
flash  from  a  witty  person  comforting,  whereas 
a  humorous  person  radiates  a  general  pleasure, 
like  another  candle  in  the  room. 


Limited  distribution  by  permission  of  Educational  Testing 
Services,  the  copyright  owner. 
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1.    The  phrase  "draw  an  exact  line"  (line  1)  means  that  ^he  author  is 
attempting  to  show  that  wit  and  humor  are 

(A)  not  as  common  today  as  in  the  past 

(B)  quite  different  from  each  other 

(C)  pleasant,  but  only  in  limited  doses 

(D)  as  unpredictable  as  people  themselves 


2.    Which  of  the  following  best  expresses  the  author's  main 
point? 

(A)  It  is  more  pleasant  to  be  with  humorous  people  than 
witty  people, 

(B)  Humor  is  more  difficult  to  achieve  than  wit. 

(C)  Humorous  people  make  friends  easily, 

(D)  Witty  people  are  not  usually  humorous,  but  humorous 
people  are  usually  witty. 


:j.     The  author  uses  marionettes  to  illustrate  that  humorous  people 

(A)  smile  frequently 

(B)  control  their  companion  ■ 

(C)  are  old  fashioned 

(D)  are  not  genuine 

4,     The  author  implies  that  witty  people  are  likely  to  make 
remarks  that  are 

(A)  insincere 

(B)  emotional 

(C)  displeasing 

(D)  irrelevant 


Kev: 

1.  B 

2.  A 

3.  A 

4.  C 


Limited  distribution  by  permission  of  Educational  Testing 
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SAMPLE  ITEMS 
NELS  U.S.  HISTORY/CITIZENSHIP/GEOGRAPHY 


Test  directions:. 


Each 
•five 
draw 


of  the  questions  in 
suggested  answers, 
a  circle  around  the 


this  section  is  -followed 
Select  the  best  -for  each 
letter  of  the  answer  you 


by  two,  four  or 
question ,  then 
choose. 


1. 


What  does  the  shaded  area  on  the  map  above  represent? 

(A)  The  Louisiana  Purchase 

(B)  The  Gadsden  Purchase 

(C)  The  states  that  stayed  in  the  Union 

(D)  The  original  thirteen  colonies 


2.       What  is  the  purpose  of  most  of  the  rights  protected  by  the 
United  States  Constitution? 

(A)  To  abol  sh  poverty 

<B>  To  help  police  do  their  job 

(C)  To  make  court  action  simpler 

(D)  To  guarar-.ee  individual  freedoms 

(E)  To  support  the  decisions  of  the  President 


3.       Brown- v.  Boar^o*_Education_o*_Topeka  (1954)   involved  a 
Tamou*  Supreme"Court~decision"wFich  has  greatly  a-f-fected 
education  in  the  United  State*. 

What  was  the  decision  in  this  case? 

(A)  The  right  o-f  Black  people  to  attend  integrated  schools 
was  innured. 

(B)  The  rights  o-f  states  to  determine  school  admittance 
policies  was  upheld. 

(C)  Separate  schools  were  ruled  inherently  unequal. 

(D)  The  right  o-f  the  -federal  government  to  run  schools  was 
guaranteed. 


Key.: 

1.  D 

2.  D 

3.  C 
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SAMPLE  ITEMS  -  NELS  SCIENCE  TEST 


111 t _dir ec t i on s * 

Each  of  the  question  in  this  section  is  followed  by  three,  -four 
or  five  suggested  answers.     Select  the  best  answer  for  each 
questions,  then  draw  •  circle  around  the  letter  of  the  answer  you 
choose . 

1        You  have  a  specific  amount  of  a  salt  that  you  wish  to 

dissolve  in  a  large  container  of  water.     The  rate  at  which 
the  salt  dissolves  will  be  increased  by  all  of  the  following 
actions  EXCEPT 

(A)  heating  the  water 

(B)  crushing  the  salt 

(C)  stirring  the  water 

(D)  decreasing  the  volume  of  the  water 

2.       Why  can  astronauts  wearing  space  suits  jump  much  higher  on 
the  Moon  than  on  the  Earth? 

(A)  The  pull  of  gravity  on  the  Moon  is  much  less  than  it  is 
on  the  Earth. 

(B)  There  is  no  air  cn  the  Moon. 

(C)  Their  spacesuits  htalp  them  to  jump  farther. 

(D)  The  Moon  has  less  -nagnetism  than  the  Earth  has. 


3.       People  who  are  trying  to  lose  weight  often  count  calories. 
What  is  measured  by  counting  calories? 

C\)  The  i  mount  of  a  special   kind  of  diet  food 

^)  The  amount  of  fat  in  a  person's  body 

(C)  The  amount  of  energy  in  the  foods  a  person  eats 

(D)  The  weight  of  the  different  foods  a  person  eats 
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4        What  rt  th.  probability  that  two  people  who  are  heterozygous 
Tor  brown  eye  (Bb)  will  have  a  blue-eyed  child?     <B  -  gene 
for  brown  eye  col  or |  b  *  gene  for  blue  eye  color) 


(A)  07. 

(B)  25V. 

(C)  SOV. 

(D)  75V. 


1.  D 

2.  A 

3.  C 

4.  B 
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SAMPLE  ITEMS  -  NELS  MATHEMATICS 


last  .slicafitioQ!  i 

Qutftiom  1^3  each  consist  of  two  quantities,  one  in  Column  A  and 
one~in~Column  B.     You  are  to  compare  thr  two  quantities  and  in 
your  test  booklet  completely  -fill  in  the  space 

A  if  the  quantity  in  Column  A  is  greater} 
B  if  the  quantity  in  Column  B  is  greaterj 
C  if  the  two  quantities  are  equal) 

D  if  the  relationship  cannot  be  determined  -from  the 
information  given. 

Notesi     1.     In  certain  questions,  information  concerning  one  or 
"      -  both  of  the  quantities  to  be  compared  is  centered 

above  the  two  columns. 

2.  A  symbol  that  appears  in  both  columns  represents  the 
same  thing  in  Column  A  ai  it  does  in  Column  B. 

3.  Letters  such  as  x,  n,  and  k  stand  for  real  numbers. 


COLUMN  A 


1.       x  if  x  +  3  *  6 


COLUMNS 

y  if  y  +  3  »  5  ABCD 


2.     Value  of  l 1  dimes 


*1.  U 


BCD 


3.     Length  represented  by 
3  inches  on  a  scale 
of  4  feet  to  an  inch 


A  length  of   12  feet 


ABCD 


Question  4.     Following  -ach  problem  in  this  section,  there  are 
thr5e7"7our  or  -five  suggested  answers.     Work  each  problem  in  your 
head  or  on  a  blank  space  provided  at  the  right  o-f  the  page.  Then 
look  at  the  suggested  answers  and  decide  which  one  is  best.  Draw 
a  circle  around  the  letter  o-f  the  answer  you  choose. 

Notei  Figures  that  accompany  problems  in  this  section  are  drawn 
as"accurately  as  possible  EXCEPT  when  it  is  stated  in  a  *peci-fic 
problem  that  its  -figure  is  not  drawn  to  scale. 


1.0  ljl 

I  ■  '  ■  '  1  '  '  1  1  I 


Tht  position  on  tht  teal* 
indictttd  by  tht  arrow  i» 

A  1.00b 

B  1.0b 

C  1.06 

D  l.b 

I  1.8 


4.       The  position  on  the  scale  indicated  by  the  arrow  is 

(A)  1.004 

(B)  1.04 

(C)  1.08 

(D)  1.4 

(E)  l.P 


KSY.« 

1.  A 

2.  A 

3.  6 

4.  B 
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